From Real-Time Conversation to User Story: Leveraging Agile Requirements through LLM

User stories have become the most widely adopted technique for requirements elicitation and documentation in agile teams. However, ensuring high-quality requirements through user stories remains a significant challenge. Natural Language Processing (NLP) techniques have been proposed to enhance the quality of these artifacts, but technological constraints have limited their effectiveness. More recently, the emergence of Large Language Models (LLMs) has prompted new approaches. Nonetheless, existing proposals remain preliminary and constrained. This research presents a conceptual framework for an LLM-based approach designed to support the generation of high-quality user stories from real-time conversations with end-users, thereby reducing the reliance on traditional requirements documents. The approach integrates context-specific information and incorporates automated and manual validation steps to ensure the quality of LLM-generated content and mitigate hallucinations. A preliminary evaluation was conducted with software engineering experts to evaluate the proposed approach's adherence to real-world problems. The proposal was perceived as easy to use, effective, and capable of producing high-quality outcomes. Furthermore, participants expressed a positive experience with both the introduction to the approach and their involvement in the evaluation. This engagement prompted reflections on novel opportunities for integrating LLMs into their professional practices.

Authors

Institutions

Publication Details

Published
2025-09-22
DOI
https://doi.org/10.5753/sbes.2025.10988
Primary Topic
Software Engineering Techniques and Practices
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Real-Time Conversation to User Story: Leveraging Agile Requirements through LLM

Ramon Martinez Pereira, Sheila Reinehr, Andreia Malucelli
Software Engineering Techniques and Practices
article

From Real-Time Conversation to User Story: Leveraging Agile Requirements through LLM

Ramon Martinez Pereira, Sheila Reinehr, Andreia Malucelli
article en

Abstract

User stories have become the most widely adopted technique for requirements elicitation and documentation in agile teams. However, ensuring high-quality requirements through user stories remains a significant challenge. Natural Language Processing (NLP) techniques have been proposed to enhance the quality of these artifacts, but technological constraints have limited their effectiveness. More recently, the emergence of Large Language Models (LLMs) has prompted new approaches. Nonetheless, existing proposals remain preliminary and constrained. This research presents a conceptual framework for an LLM-based approach designed to support the generation of high-quality user stories from real-time conversations with end-users, thereby reducing the reliance on traditional requirements documents. The approach integrates context-specific information and incorporates automated and manual validation steps to ensure the quality of LLM-generated content and mitigate hallucinations. A preliminary evaluation was conducted with software engineering experts to evaluate the proposed approach's adherence to real-world problems. The proposal was perceived as easy to use, effective, and capable of producing high-quality outcomes. Furthermore, participants expressed a positive experience with both the introduction to the approach and their involvement in the evaluation. This engagement prompted reflections on novel opportunities for integrating LLMs into their professional practices.

Pontifical Catholic University of Puerto Rico (PR)
Openalex Percentile: Top 59%
Software Engineering Techniques and Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.