A Reflection on Change Classification in the Era of Large Language Models

Change classification, today known as Just-in-Time Defect Prediction, is a technique for predicting software bugs at the change level of granularity. Several ideas came together to form change classification: predictions on code changes, using word-level textual features, use of machine learning classifiers, and leveraging open source code repositories. While change classification has led to a robust line of research, it has not yet had significant industrial adoption. A key recommendation is to explore explainability features so developers can better understand why a prediction is being made. We explore how large language models can advance this work by providing prediction explanations and bug fix suggestions.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Software Engineering
Published
2025-02-05
DOI
https://doi.org/10.1109/tse.2025.3539566
Citations
2
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
10.68
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Reflection on Change Classification in the Era of Large Language Models

Shivkumar Shivaji, Jim Whitehead, Sunghun Kim
2 citations
IEEE Transactions on Software Engineering
Computational and Text Analysis Methods
10.68
article

A Reflection on Change Classification in the Era of Large Language Models

Shivkumar Shivaji, Jim Whitehead, Sunghun Kim
article en
2 citations

Abstract

Change classification, today known as Just-in-Time Defect Prediction, is a technique for predicting software bugs at the change level of granularity. Several ideas came together to form change classification: predictions on code changes, using word-level textual features, use of machine learning classifiers, and leveraging open source code repositories. While change classification has led to a robust line of research, it has not yet had significant industrial adoption. A key recommendation is to explore explainability features so developers can better understand why a prediction is being made. We explore how large language models can advance this work by providing prediction explanations and bug fix suggestions.

IEEE Transactions on Software EngineeringVol. 51(3)
University of California, Santa Cruz (US), Hong Kong University of Science and Technology (HK), Partners In Care (US), China National Chemical Corporation (China) (CN)
Openalex Percentile: Top 3%
Computational and Text Analysis Methods
10.68
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Reflection on Change Classification in the Era of Large Language Models — Shivkumar Shivaji, Jim Whitehead, et al. · IEEE Transactions on Software Engineering (2025) | TGRS Research Map | TGRS