An LLM-based Multi-stage Approach for Automated Test Case Generation from User Stories (S)

Requirements-driven testing is crucial for validating functionality and maintaining software quality during the early stages of development.It is usually done manually by experienced experts, which is timeconsuming and thus affects development efficiency.Although a number of approaches have been proposed to automate the generation of test cases, they primarily rely on (semi-)formalized requirements and thus cannot be applied to user stories and other natural language-based requirements specifications that are more prevalent in practice.In this paper, we propose an incrementally refined multi-stage method that utilizes LLM to generate test cases from user stories automatically.Specifically, we design a systematic process to incrementally refine user stories and transform them into test cases in multiple stages.We compare the consistency, reasonable, testability, coverage, and time consumption of test cases generated by our method to those designed by experts and find that our proposal outperforms baseline methods in terms of all metrics, achieving 4.8 points testability and 86.36% coverage compared to the baseline's 4.5 points and 44.64%.This indicates a promising direction for improving the practicality and efficiency of test case generation from user stories.

Authors

Institutions

Publication Details

Journal
Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering
Published
2024-10-28
DOI
https://doi.org/10.18293/seke2024-087
Citations
1
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.49

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An LLM-based Multi-stage Approach for Automated Test Case Generation from User Stories (S)

Qixiang Zhou, Jiahong Sun, Jiaxuan Li, Li Tong
1 citations
Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering
Software Testing and Debugging Techniques
0.49
article

An LLM-based Multi-stage Approach for Automated Test Case Generation from User Stories (S)

Qixiang Zhou, Jiahong Sun, Jiaxuan Li, Li Tong
article en
1 citations

Abstract

Requirements-driven testing is crucial for validating functionality and maintaining software quality during the early stages of development.It is usually done manually by experienced experts, which is timeconsuming and thus affects development efficiency.Although a number of approaches have been proposed to automate the generation of test cases, they primarily rely on (semi-)formalized requirements and thus cannot be applied to user stories and other natural language-based requirements specifications that are more prevalent in practice.In this paper, we propose an incrementally refined multi-stage method that utilizes LLM to generate test cases from user stories automatically.Specifically, we design a systematic process to incrementally refine user stories and transform them into test cases in multiple stages.We compare the consistency, reasonable, testability, coverage, and time consumption of test cases generated by our method to those designed by experts and find that our proposal outperforms baseline methods in terms of all metrics, achieving 4.8 points testability and 86.36% coverage compared to the baseline's 4.5 points and 44.64%.This indicates a promising direction for improving the practicality and efficiency of test case generation from user stories.

Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge EngineeringVol. 2024
Beijing University of Technology (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 27%
Software Testing and Debugging Techniques
0.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An LLM-based Multi-stage Approach for Automated Test Case Generation from User Stories (S) — Qixiang Zhou, Jiahong Sun, et al. · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering (2024) | TGRS Research Map | TGRS