ET-SDP: Enhancing Code Embeddings with Effort-Related and Test Coverage Metrics for Improved Software Defect Prediction

Abstract Software defect prediction (SDP) aims to identify defect-prone code modules in order to optimize testing resources and improve software quality. While traditional approaches rely on software metrics derived from code structure, this paper proposes , an approach that enhances code embeddings using effort-related and test coverage metrics. We introduce three feature sets: the top-30 software metrics selected through clustering relevance ranking, 170 effort-related metrics capturing development process characteristics, and five test coverage metrics derived from unit tests. Our evaluation on 15 releases of Apache Calcite and 6 releases of Apache Ant-Ivy demonstrates that effort-related and test coverage metrics provide better defect prediction performance with far fewer features than traditional software metrics. In unsupervised clustering experiments, effort-based embeddings achieve better alignment with defect labels. In supervised classification, effort-related features achieve an AUC of 0.932 on Calcite and 0.883 on Ant-Ivy, outperforming the top-30 software metrics at comparable feature count (AUC of 0.632 and 0.587, respectively). Feature importance analysis reveals that test coverage metrics are the strongest predictors of defect proneness. These findings suggest that process-oriented metrics, particularly those related to code testing and development history, capture defect patterns more effectively per feature than static code structure metrics, offering practical guidance for software quality assurance.

Authors

Institutions

Publication Details

Journal
Acta Universitatis Sapientiae Informatica
Published
2026-08-24
DOI
https://doi.org/10.1007/s44427-026-00038-3
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ET-SDP: Enhancing Code Embeddings with Effort-Related and Test Coverage Metrics for Improved Software Defect Prediction

Zsuzsanna Marian, Ioana-Gabriela Chelaru, Gabriela Czibula, Istvan-Gergely Czibula
Acta Universitatis Sapientiae Informatica
Software Engineering Research
article

ET-SDP: Enhancing Code Embeddings with Effort-Related and Test Coverage Metrics for Improved Software Defect Prediction

Zsuzsanna Marian, Ioana-Gabriela Chelaru, Gabriela Czibula, Istvan-Gergely Czibula
article en

Abstract

Abstract Software defect prediction (SDP) aims to identify defect-prone code modules in order to optimize testing resources and improve software quality. While traditional approaches rely on software metrics derived from code structure, this paper proposes , an approach that enhances code embeddings using effort-related and test coverage metrics. We introduce three feature sets: the top-30 software metrics selected through clustering relevance ranking, 170 effort-related metrics capturing development process characteristics, and five test coverage metrics derived from unit tests. Our evaluation on 15 releases of Apache Calcite and 6 releases of Apache Ant-Ivy demonstrates that effort-related and test coverage metrics provide better defect prediction performance with far fewer features than traditional software metrics. In unsupervised clustering experiments, effort-based embeddings achieve better alignment with defect labels. In supervised classification, effort-related features achieve an AUC of 0.932 on Calcite and 0.883 on Ant-Ivy, outperforming the top-30 software metrics at comparable feature count (AUC of 0.632 and 0.587, respectively). Feature importance analysis reveals that test coverage metrics are the strongest predictors of defect proneness. These findings suggest that process-oriented metrics, particularly those related to code testing and development history, capture defect patterns more effectively per feature than static code structure metrics, offering practical guidance for software quality assurance.

Acta Universitatis Sapientiae InformaticaVol. 18(1)
Babeș-Bolyai University (RO)
Health Resources in Action, Universitatea Babeș-Bolyai
Industry, innovation and infrastructure
Openalex Percentile: Top 3%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.