AI-Enhanced Mutation Testing in Software Engineering

Mutation testing is a fault-based software testing technique that evaluates test suite effectiveness by introducing small changes, called mutants, into program code and measuring whether existing tests can detect them. Despite its strong theoretical foundations, traditional mutation testing faces adoption barriers, including high computational cost, equivalent and redundant mutants, and the manual effort required to write new tests. Recent advances in Artificial Intelligence (AI), particularly in machine learning, deep learning, and large language models (LLMs), offer new opportunities to address these challenges. AI can enhance mutation testing through intelligent mutant generation, predictive mutant selection, equivalent mutant detection, and automated test case generation. This paper provides a detailed survey of AI-driven techniques applied to mutation testing, reviews prominent academic and industrial case studies such as DeepMutation, MOTIF, and Meta’s Automated Compliance Hardening (ACH) system, and outlines future research directions. By integrating AI into the mutation testing workflow, the process can become more selective, context-driven, and automated, enabling its practical use in large-scale, real-world software engineering projects.

Authors

Publication Details

Published
2025-08-26
DOI
https://doi.org/10.36227/techrxiv.175624516.68019515/v1
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Enhanced Mutation Testing in Software Engineering

Nityanand Rai, Pankaj Bhandula
Scientific Computing and Data Management
article

AI-Enhanced Mutation Testing in Software Engineering

Nityanand Rai, Pankaj Bhandula
article en

Abstract

Mutation testing is a fault-based software testing technique that evaluates test suite effectiveness by introducing small changes, called mutants, into program code and measuring whether existing tests can detect them. Despite its strong theoretical foundations, traditional mutation testing faces adoption barriers, including high computational cost, equivalent and redundant mutants, and the manual effort required to write new tests. Recent advances in Artificial Intelligence (AI), particularly in machine learning, deep learning, and large language models (LLMs), offer new opportunities to address these challenges. AI can enhance mutation testing through intelligent mutant generation, predictive mutant selection, equivalent mutant detection, and automated test case generation. This paper provides a detailed survey of AI-driven techniques applied to mutation testing, reviews prominent academic and industrial case studies such as DeepMutation, MOTIF, and Meta’s Automated Compliance Hardening (ACH) system, and outlines future research directions. By integrating AI into the mutation testing workflow, the process can become more selective, context-driven, and automated, enabling its practical use in large-scale, real-world software engineering projects.

Openalex Percentile: Top 78%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.