GMR-165 An Empirical Study of Prompt-based Non-functional Requirements Classification

In modern software development, Non-Functional Requirements (NFR) are essential to satisfy users’ needs. Distinguishing different categories of NFR is tedious, error-prone, and time consuming due to the complexity of software systems. In our project, we conducted a comprehensive study to evaluate the performance of prompt-based NFR classification by designing various handcraft templates and soft templates on the pre-trained language model (i.e., BERT). Our experimental results show that handcraft templates can achieve best effectiveness (e.g., 83.52% in terms of F1 score) but with unstable performance for different templates.

Publication Details

Journal
DigitalCommons - Kennesaw State University (Kennesaw State University)
Published
2024-11-20
Primary Topic
Colonialism, slavery, and trade
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GMR-165 An Empirical Study of Prompt-based Non-functional Requirements Classification

DigitalCommons - Kennesaw State University (Kennesaw State University)
Colonialism, slavery, and trade
article

GMR-165 An Empirical Study of Prompt-based Non-functional Requirements Classification

article en

Abstract

In modern software development, Non-Functional Requirements (NFR) are essential to satisfy users’ needs. Distinguishing different categories of NFR is tedious, error-prone, and time consuming due to the complexity of software systems. In our project, we conducted a comprehensive study to evaluate the performance of prompt-based NFR classification by designing various handcraft templates and soft templates on the pre-trained language model (i.e., BERT). Our experimental results show that handcraft templates can achieve best effectiveness (e.g., 83.52% in terms of F1 score) but with unstable performance for different templates.

DigitalCommons - Kennesaw State University (Kennesaw State University)
Industry, innovation and infrastructure
Openalex Percentile: Top 27%
Colonialism, slavery, and trade
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

GMR-165 An Empirical Study of Prompt-based Non-functional Requirements Classification · DigitalCommons - Kennesaw State University (Kennesaw State University) (2024) | TGRS Research Map | TGRS