Intelligent Test Management Optimization: A Machine Learning Framework for Enhanced Software Testing Decision-Making

Software testing remains an essential and challenging part of today's software development, especially in Continuous Integration (CI) environments, where tests must be decided on quickly. This paper introduces a new framework, ITMOS (intelligent test management optimisation system), based on machine learning and natural language processing, to automate important test management decisions. The system tackles two core problems: automatic mapping of suitable CI configurations to requirements' characteristics, and intelligent suggestions for test automation strategies. With an ensemble approach in place of semantic classifiers, word-distribution analysers, and categorical data processors, ITMOS reaches F1-scores of 0.9163 for CI configuration classification and 0.9463 for test automation recommendations. Industrial validation demonstrates significant improvements in decision speed (a 96% speedup), consistency (a 100% agreement rate compared to 76% manual agreement), and global testing efficiency. This framework is a significant advancement in intelligent software engineering tools, with applied solutions to scalable ways of managing tests in large development contexts.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-08-02
DOI
https://doi.org/10.5281/zenodo.16743657
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Intelligent Test Management Optimization: A Machine Learning Framework for Enhanced Software Testing Decision-Making

Zenodo (CERN European Organization for Nuclear Research)
Software Testing and Debugging Techniques
article

Intelligent Test Management Optimization: A Machine Learning Framework for Enhanced Software Testing Decision-Making

article en

Abstract

Software testing remains an essential and challenging part of today's software development, especially in Continuous Integration (CI) environments, where tests must be decided on quickly. This paper introduces a new framework, ITMOS (intelligent test management optimisation system), based on machine learning and natural language processing, to automate important test management decisions. The system tackles two core problems: automatic mapping of suitable CI configurations to requirements' characteristics, and intelligent suggestions for test automation strategies. With an ensemble approach in place of semantic classifiers, word-distribution analysers, and categorical data processors, ITMOS reaches F1-scores of 0.9163 for CI configuration classification and 0.9463 for test automation recommendations. Industrial validation demonstrates significant improvements in decision speed (a 96% speedup), consistency (a 100% agreement rate compared to 76% manual agreement), and global testing efficiency. This framework is a significant advancement in intelligent software engineering tools, with applied solutions to scalable ways of managing tests in large development contexts.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 50%
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Intelligent Test Management Optimization: A Machine Learning Framework for Enhanced Software Testing Decision-Making · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS