Persona-driven automated extraction of non-functional requirements using LLM agents

The extraction of non-functional requirements (NFRs) is a crucial yet complex task in information system development, often requiring extensive domain expertise. Traditional persona-driven approaches rely on expert-driven manual processes, which can be inconsistent and inefficient. To address this challenge, we propose an LLM-based autonomous agent framework for persona-driven NFR extraction, integrating Retrieval-Augmented Generation (RAG) to enhance contextual adaptation. The framework systematically automates persona generation, scenario-based experience simulation, interview question formulation, response evaluation, and final NFR specification, incorporating iterative refinement mechanisms. To evaluate its effectiveness, we conducted a case study using a real-world procurement specification, comparing RAG-enabled and non-RAG conditions. Experimental results demonstrate that RAG improves the contextual relevance of interview questions, with an average Context Relevancy Score of 0.5135 compared to 0.4795 without RAG. Additionally, RAG-enabled interviews exhibited broader information coverage in the initial round, as indicated by Convex Hull Volume analysis. However, dynamic flow control mechanisms ensured that non-RAG conditions, through iterative refinement, achieved comparable final NFR completeness. Human evaluation confirmed that the proposed framework generates consistent, structured, and comprehensive NFR specifications while reducing dependency on manual expertise. These findings highlight the potential of integrating LLM agents and RAG to enhance automation and coverage in NFR extraction. Future work will focus on refining adaptive RAG application mechanisms and optimizing persona-driven question generation strategies to further improve the efficiency and accuracy of NFR specification processes.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.09.167
Citations
2
Primary Topic
Persona Design and Applications
Type
article
Field-Weighted Citation Impact
3.87
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Persona-driven automated extraction of non-functional requirements using LLM agents

Shinpei Ogata, Ken‐ichi Mukaida, Kozo Okano
2 citations
Procedia Computer Science
Persona Design and Applications
3.87
article

Persona-driven automated extraction of non-functional requirements using LLM agents

Shinpei Ogata, Ken‐ichi Mukaida, Kozo Okano
article en
2 citations

Abstract

The extraction of non-functional requirements (NFRs) is a crucial yet complex task in information system development, often requiring extensive domain expertise. Traditional persona-driven approaches rely on expert-driven manual processes, which can be inconsistent and inefficient. To address this challenge, we propose an LLM-based autonomous agent framework for persona-driven NFR extraction, integrating Retrieval-Augmented Generation (RAG) to enhance contextual adaptation. The framework systematically automates persona generation, scenario-based experience simulation, interview question formulation, response evaluation, and final NFR specification, incorporating iterative refinement mechanisms. To evaluate its effectiveness, we conducted a case study using a real-world procurement specification, comparing RAG-enabled and non-RAG conditions. Experimental results demonstrate that RAG improves the contextual relevance of interview questions, with an average Context Relevancy Score of 0.5135 compared to 0.4795 without RAG. Additionally, RAG-enabled interviews exhibited broader information coverage in the initial round, as indicated by Convex Hull Volume analysis. However, dynamic flow control mechanisms ensured that non-RAG conditions, through iterative refinement, achieved comparable final NFR completeness. Human evaluation confirmed that the proposed framework generates consistent, structured, and comprehensive NFR specifications while reducing dependency on manual expertise. These findings highlight the potential of integrating LLM agents and RAG to enhance automation and coverage in NFR extraction. Future work will focus on refining adaptive RAG application mechanisms and optimizing persona-driven question generation strategies to further improve the efficiency and accuracy of NFR specification processes.

Procedia Computer ScienceVol. 270
Shinshu University (JP), Nagano Prefecture Forestry Research Center (JP)
Openalex Percentile: Top 6%
Persona Design and Applications
3.87
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.