Security Bug Report Classification via Cross-Project Similarity-Based Data Augmentation and Deep Learning Models

Accurate classification of security bug reports is a persistent challenge in software engineering due to the limited availability of labeled security data within individual projects. This study investigates whether semantically similar bug reports from external projects can be used to augment training data and improve classification performance in cross-project scenarios. Twelve text similarity techniques are evaluated, including four lexical methods such as TF-IDF, Jaccard, Levenshtein, and BM25, as well as eight embedding-based approaches such as Word2Vec, GloVe, FastText, Doc2Vec, BERT, SBERT, USE, and BERTScore. These similarity methods are applied to identify relevant bug reports from four open-source projects. The selected reports are combined with the security-labeled reports from each target project to create augmented training datasets. Five deep learning models are trained and evaluated using these datasets: CNN, LSTM, GRU, Transformer, and BERT. The experimental results show that CNN, LSTM, and GRU consistently achieve strong performance, with F1-scores frequently exceeding 0.92 across multiple projects and similarity methods. Both lexical and embedding-based similarity techniques contribute positively to performance, although their effectiveness varies depending on the model and project. No single similarity method performs best in all settings, but specific combinations of similarity techniques and model architectures lead to significantly improved classification outcomes. These findings highlight the practical value of cross-project data augmentation for security bug report classification. They also underscore the importance of selecting similarity methods and model architectures that align with the characteristics of the target project and available training data.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3614638
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Security Bug Report Classification via Cross-Project Similarity-Based Data Augmentation and Deep Learning Models

Geunseok Yang, M. Ganzorig, Jinfeng Ji
IEEE Access
Software Engineering Research
article

Security Bug Report Classification via Cross-Project Similarity-Based Data Augmentation and Deep Learning Models

Geunseok Yang, M. Ganzorig, Jinfeng Ji
article en

Abstract

Accurate classification of security bug reports is a persistent challenge in software engineering due to the limited availability of labeled security data within individual projects. This study investigates whether semantically similar bug reports from external projects can be used to augment training data and improve classification performance in cross-project scenarios. Twelve text similarity techniques are evaluated, including four lexical methods such as TF-IDF, Jaccard, Levenshtein, and BM25, as well as eight embedding-based approaches such as Word2Vec, GloVe, FastText, Doc2Vec, BERT, SBERT, USE, and BERTScore. These similarity methods are applied to identify relevant bug reports from four open-source projects. The selected reports are combined with the security-labeled reports from each target project to create augmented training datasets. Five deep learning models are trained and evaluated using these datasets: CNN, LSTM, GRU, Transformer, and BERT. The experimental results show that CNN, LSTM, and GRU consistently achieve strong performance, with F1-scores frequently exceeding 0.92 across multiple projects and similarity methods. Both lexical and embedding-based similarity techniques contribute positively to performance, although their effectiveness varies depending on the model and project. No single similarity method performs best in all settings, but specific combinations of similarity techniques and model architectures lead to significantly improved classification outcomes. These findings highlight the practical value of cross-project data augmentation for security bug report classification. They also underscore the importance of selecting similarity methods and model architectures that align with the characteristics of the target project and available training data.

IEEE AccessVol. 13
Hankyong National University (KR)
Openalex Percentile: Top 62%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Security Bug Report Classification via Cross-Project Similarity-Based Data Augmentation and Deep Learning Models — Geunseok Yang, M. Ganzorig, et al. · IEEE Access (2025) | TGRS Research Map | TGRS