ENSEMBLE-EMPOWERED TF-IDF: SCALABLE NLP FOR AUTOMATED ECLIPSE BUG REPORT CLASSIFICATION

Software maintenance in large open-source ecosystems depends heavily on fast and accurate bug triage. The Eclipse project alone receives tens of thousands of issue reports annually, covering a wide range of components and severity levels. Traditionally, human experts perform this triage manually, a process that is time-consuming, inconsistent, and increasingly unmanageable as the scale of the project grows. Previous attempts to automate this task using single machine learning models like Support Vector Machines (SVM) or Logistic Regression have achieved moderate accuracy (approximately 70–75%), but these approaches often rely on extensive feature engineering and struggle to generalize across evolving bug datasets. This research proposes a scalable, ensemble-based framework for automating Eclipse bug classification with high accuracy. The system processes raw bug descriptions through a comprehensive preprocessing pipeline—tokenization, stop word removal, and lemmatization—and converts the text into numerical representations using Term FrequencyInverse Document Frequency (TF-IDF). It then trains and evaluates five classifiers on a curated Eclipse–Mozilla dataset: SVM, Random Forest Classifier (RFC), Logistic Regression Classifier (LRC), Extra Trees Voting (EV) ensemble, and Extreme Gradient Boosting (XGBoost). A userfriendly GUI is integrated into the system, enabling non-experts to upload data, visualize preprocessing steps, and select models. With a 70/30 train-test split, the models yield the following performance: SVM achieves 74.23% accuracy, 83.03% precision, 73.94% recall, and 75.24% F₁score; RFC scores 83.51% accuracy, 87.68% precision, 83.40% recall, and 84.09% F₁; LRC records 70.10% accuracy, 75.06% precision, 70.19% recall, and 71.10% F₁; EV ensemble achieves 89.69% accuracy, 91.10% precision, 90.29% recall, and 90.21% F₁; while XGBoost outperforms all others with 92.27% accuracy, 92.91% precision, 92.65% recall, and 92.50% F₁-score. These results underscore the strength of ensemble methods, particularly XGBoost, in delivering reliable and scalable bug classification for large open-source projects.

Authors

Publication Details

Journal
International Journal of Engineering Research and Science & Technology
Published
2025-07-14
DOI
https://doi.org/10.62643/ijerst.v21.n3(1).pp646-651
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ENSEMBLE-EMPOWERED TF-IDF: SCALABLE NLP FOR AUTOMATED ECLIPSE BUG REPORT CLASSIFICATION

T. Pravalika, Lakshmi Meenakshi Nirukurthy, Chinmayee Madduri, Bhavana Pulla
1 links
International Journal of Engineering Research and Science & Technology
Software Engineering Research
article

ENSEMBLE-EMPOWERED TF-IDF: SCALABLE NLP FOR AUTOMATED ECLIPSE BUG REPORT CLASSIFICATION

T. Pravalika, Lakshmi Meenakshi Nirukurthy, Chinmayee Madduri, Bhavana Pulla
article en

Abstract

Software maintenance in large open-source ecosystems depends heavily on fast and accurate bug triage. The Eclipse project alone receives tens of thousands of issue reports annually, covering a wide range of components and severity levels. Traditionally, human experts perform this triage manually, a process that is time-consuming, inconsistent, and increasingly unmanageable as the scale of the project grows. Previous attempts to automate this task using single machine learning models like Support Vector Machines (SVM) or Logistic Regression have achieved moderate accuracy (approximately 70–75%), but these approaches often rely on extensive feature engineering and struggle to generalize across evolving bug datasets. This research proposes a scalable, ensemble-based framework for automating Eclipse bug classification with high accuracy. The system processes raw bug descriptions through a comprehensive preprocessing pipeline—tokenization, stop word removal, and lemmatization—and converts the text into numerical representations using Term FrequencyInverse Document Frequency (TF-IDF). It then trains and evaluates five classifiers on a curated Eclipse–Mozilla dataset: SVM, Random Forest Classifier (RFC), Logistic Regression Classifier (LRC), Extra Trees Voting (EV) ensemble, and Extreme Gradient Boosting (XGBoost). A userfriendly GUI is integrated into the system, enabling non-experts to upload data, visualize preprocessing steps, and select models. With a 70/30 train-test split, the models yield the following performance: SVM achieves 74.23% accuracy, 83.03% precision, 73.94% recall, and 75.24% F₁score; RFC scores 83.51% accuracy, 87.68% precision, 83.40% recall, and 84.09% F₁; LRC records 70.10% accuracy, 75.06% precision, 70.19% recall, and 71.10% F₁; EV ensemble achieves 89.69% accuracy, 91.10% precision, 90.29% recall, and 90.21% F₁; while XGBoost outperforms all others with 92.27% accuracy, 92.91% precision, 92.65% recall, and 92.50% F₁-score. These results underscore the strength of ensemble methods, particularly XGBoost, in delivering reliable and scalable bug classification for large open-source projects.

International Journal of Engineering Research and Science & TechnologyVol. 21(3 (1))
Openalex Percentile: Top 75%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

ENSEMBLE-EMPOWERED TF-IDF: SCALABLE NLP FOR AUTOMATED ECLIPSE BUG REPORT CLASSIFICATION — T. Pravalika, Lakshmi Meenakshi Nirukurthy, et al. · International Journal of Engineering Research and Science & Technology (2025) | TGRS Research Map | TGRS