On the Use of Artificial Intelligence in Software Testing: State of the Art and Application to Satellite Systems

The integration of Artificial Intelligence (AI) into software testing has emerged as a promising approach to addressing the limitations of conventional methods, particularly in safety-critical domains such as automotive and aerospace. Traditional software testing is often manual, resource-intensive, and prone to incomplete coverage. In contrast, AI-based techniques have been applied to automate test case generation, optimise testing processes, and improve defect prediction. This study extends these approaches to the context of Embodied AI, where the reliability of systems that perceive and act within complex environments is a primary concern. Autonomous satellites are considered as representative embodied agents, for which the robustness of the perception–action loop is mission-critical. The paper presents two main contributions. First, it reviews the state of the art in the application of AI techniques to software testing. Second, it demonstrates the practical viability of these techniques through a proof of concept (PoC) in the satellite domain. In this PoC, generative AI is used to create synthetic datasets simulating adverse atmospheric conditions, including varying levels of cloud opacity. These datasets are used to evaluate and improve an on-board object detection model. Experimental results indicate that this approach reveals limitations of the baseline model and, following retraining, enhances robustness under challenging conditions while maintaining performance in clear scenarios. The findings demonstrate the potential of AI-based testing methodologies to support the validation and improvement of mission-critical embodied systems.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Cyber-Physical Systems
Published
2026-02-23
DOI
https://doi.org/10.1145/3783988
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On the Use of Artificial Intelligence in Software Testing: State of the Art and Application to Satellite Systems

Leonidas Kosmidis, Stefano Sinisi, Jannis Wolf, Alejandro J. Calderón et al.
ACM Transactions on Cyber-Physical Systems
Software Testing and Debugging Techniques
article

On the Use of Artificial Intelligence in Software Testing: State of the Art and Application to Satellite Systems

Leonidas Kosmidis, Stefano Sinisi, Jannis Wolf, Alejandro J. Calderón, Mar Hernández, Giulia Stazi, Ricardo Arnaiz, Valerio Di Valerio
article en

Abstract

The integration of Artificial Intelligence (AI) into software testing has emerged as a promising approach to addressing the limitations of conventional methods, particularly in safety-critical domains such as automotive and aerospace. Traditional software testing is often manual, resource-intensive, and prone to incomplete coverage. In contrast, AI-based techniques have been applied to automate test case generation, optimise testing processes, and improve defect prediction. This study extends these approaches to the context of Embodied AI, where the reliability of systems that perceive and act within complex environments is a primary concern. Autonomous satellites are considered as representative embodied agents, for which the robustness of the perception–action loop is mission-critical. The paper presents two main contributions. First, it reviews the state of the art in the application of AI techniques to software testing. Second, it demonstrates the practical viability of these techniques through a proof of concept (PoC) in the satellite domain. In this PoC, generative AI is used to create synthetic datasets simulating adverse atmospheric conditions, including varying levels of cloud opacity. These datasets are used to evaluate and improve an on-board object detection model. Experimental results indicate that this approach reveals limitations of the baseline model and, following retraining, enhances robustness under challenging conditions while maintaining performance in clear scenarios. The findings demonstrate the potential of AI-based testing methodologies to support the validation and improvement of mission-critical embodied systems.

ACM Transactions on Cyber-Physical Systems
Barcelona Supercomputing Center (ES), Ikerlan (ES), Piaggio Aerospace (Italy) (IT), Universitat Politècnica de Catalunya (ES)
Openalex Percentile: Top 56%
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.