Code Comment Classification with Data Augmentation and Transformer-Based Models

Effective classification of code comment sentences into meaningful categories is critical for software comprehension and maintenance. In this work, we present a solution for the NLBSE'25 Code Comment Classification Tool Competition, achieving a 6.7% improvement in accuracy over the baseline STACC models. Our solution employs a multi-step methodology, beginning with translation-retranslation techniques to generate synthetic datasets. By translating the original dataset into multiple languages and back into English, we introduce linguistic diversity that enriches the training data and improves model generalization. We fine-tuned transformer-based architectures, including BERT, CodeBERT, RoBERTa, and DistilBERT, on this augmented dataset. After extensive evaluation, the best-performing model is selected for a robust multi-label classification framework tailored to Java, Python, and Pharo databases. The framework is designed to address the unique challenges of each programming language, ensuring high precision, recall, and F1 scores across all 19 categories. The source code is publicly available at https://github.com/Musfiqur6087/NLBSE-25, and the trained model can be accessed at https://huggingface.comMushfiqurRR.

Authors

Institutions

Publication Details

Published
2025-04-27
DOI
https://doi.org/10.1109/nlbse66842.2025.00013
Citations
2
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Code Comment Classification with Data Augmentation and Transformer-Based Models

Mohammed Latif Siddiq, Mushfiqur Rahman
2 citations
Natural Language Processing Techniques
4.96
article

Code Comment Classification with Data Augmentation and Transformer-Based Models

Mohammed Latif Siddiq, Mushfiqur Rahman
article en
2 citations

Abstract

Effective classification of code comment sentences into meaningful categories is critical for software comprehension and maintenance. In this work, we present a solution for the NLBSE'25 Code Comment Classification Tool Competition, achieving a 6.7% improvement in accuracy over the baseline STACC models. Our solution employs a multi-step methodology, beginning with translation-retranslation techniques to generate synthetic datasets. By translating the original dataset into multiple languages and back into English, we introduce linguistic diversity that enriches the training data and improves model generalization. We fine-tuned transformer-based architectures, including BERT, CodeBERT, RoBERTa, and DistilBERT, on this augmented dataset. After extensive evaluation, the best-performing model is selected for a robust multi-label classification framework tailored to Java, Python, and Pharo databases. The framework is designed to address the unique challenges of each programming language, ensuring high precision, recall, and F1 scores across all 19 categories. The source code is publicly available at https://github.com/Musfiqur6087/NLBSE-25, and the trained model can be accessed at https://huggingface.comMushfiqurRR.

University of Notre Dame (US), Bangladesh University of Engineering and Technology (BD)
Affordable and clean energy
Openalex Percentile: Top 5%
Natural Language Processing Techniques
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Code Comment Classification with Data Augmentation and Transformer-Based Models — Mohammed Latif Siddiq, Mushfiqur Rahman · (2025) | TGRS Research Map | TGRS