Building Defect Prediction Models by Online Learning Considering Defect Overlooking

Building defect prediction models based on online learning can enhance prediction accuracy. It continuously rebuilds a new prediction model while adding new data points. However, a module predicted as “non-defective” can result in fewer test cases for such modules. Thus, a defective module can be overlooked during testing. The erroneous test results are used as learning data by online learning, which could negatively affect prediction accuracy. To suppress the negative influence, we propose to apply a method that fixes the prediction as positive during the initial stage of online learning. Additionally, we improved the method to consider the probability of defect overlooking. In our experiment, we demonstrate this negative influence on prediction accuracy and the effectiveness of our approach. The results show that our approach did not negatively affect AUC but significantly improved recall.

Authors

Institutions

Publication Details

Journal
IEICE Transactions on Information and Systems
Published
2024-09-08
DOI
https://doi.org/10.1587/transinf.2024mpl0001
Citations
1
Primary Topic
Industrial Vision Systems and Defect Detection
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Building Defect Prediction Models by Online Learning Considering Defect Overlooking

Nikolay Fedorov, Kwabena Ebo Bennin, Masateru Tsunoda, Amjed Tahir et al.
1 citations
IEICE Transactions on Information and Systems
Industrial Vision Systems and Defect Detection
0.35
article

Building Defect Prediction Models by Online Learning Considering Defect Overlooking

Nikolay Fedorov, Kwabena Ebo Bennin, Masateru Tsunoda, Amjed Tahir, Keitaro Nakasai, Akito Monden, Yuta Yamasaki, Koji Toda
article en
1 citations

Abstract

Building defect prediction models based on online learning can enhance prediction accuracy. It continuously rebuilds a new prediction model while adding new data points. However, a module predicted as “non-defective” can result in fewer test cases for such modules. Thus, a defective module can be overlooked during testing. The erroneous test results are used as learning data by online learning, which could negatively affect prediction accuracy. To suppress the negative influence, we propose to apply a method that fixes the prediction as positive during the initial stage of online learning. Additionally, we improved the method to consider the probability of defect overlooking. In our experiment, we demonstrate this negative influence on prediction accuracy and the effectiveness of our approach. The results show that our approach did not negatively affect AUC but significantly improved recall.

IEICE Transactions on Information and SystemsVol. E108.D(3)
Fukuoka Institute of Technology (JP), Okayama University (JP), Metropolitan University College (DK), Institute of Informatics of the Slovak Academy of Sciences (SK), Massey University (NZ), Wageningen University & Research (NL), Kindai University (JP)
Japan Society for the Promotion of Science
Climate action
Openalex Percentile: Top 37%
Industrial Vision Systems and Defect Detection
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.