A Hybrid Software Testing Recommendation System Based on Bugs and Tests Descriptions

During the software development cycle, there is often a need to run tests after correcting a bug. The tests to be executed are only a few times automated, demanding even more time from the tester. In addition to the testing time, there is also the difficulty in selecting the tests that should be executed at that moment, as depending on the size of the software, the number of tests reaches thousands. In this research, we propose a hybrid model for recommending manual tests, which, based on the bug description and test steps, selects the best tests to be carried out to check whether a given bug has been resolved. This work was developed using real-world data from software under development, which features manual user interface tests. During development, our application presented an accuracy rate of 60.82% through the Recall@20 metric using the training data, which was confirmed through the use of human users, where the system presented an accuracy rate of 59.70%.

Authors

Institutions

Publication Details

Published
2025-05-05
DOI
https://doi.org/10.1109/cscwd64889.2025.11033283
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hybrid Software Testing Recommendation System Based on Bugs and Tests Descriptions

Júlio César Nievola, Gregory Moro Puppi Wanderley, Bruno Kostiuk, César Augusto Tacla et al.
1 links
Software Testing and Debugging Techniques
article

A Hybrid Software Testing Recommendation System Based on Bugs and Tests Descriptions

Júlio César Nievola, Gregory Moro Puppi Wanderley, Bruno Kostiuk, César Augusto Tacla, Antônio David Viniski, Emerson Cabrera Paraíso
article en

Abstract

During the software development cycle, there is often a need to run tests after correcting a bug. The tests to be executed are only a few times automated, demanding even more time from the tester. In addition to the testing time, there is also the difficulty in selecting the tests that should be executed at that moment, as depending on the size of the software, the number of tests reaches thousands. In this research, we propose a hybrid model for recommending manual tests, which, based on the bug description and test steps, selects the best tests to be carried out to check whether a given bug has been resolved. This work was developed using real-world data from software under development, which features manual user interface tests. During development, our application presented an accuracy rate of 60.82% through the Recall@20 metric using the training data, which was confirmed through the use of human users, where the system presented an accuracy rate of 59.70%.

Universidade Tecnológica Federal do Paraná (BR), Pontifícia Universidade Católica do Paraná (BR), Universidade Federal do Pará (BR)
Openalex Percentile: Top 85%
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.