A Multimodal Deep Learning Model for Cross-Project Issue Classification

Software continuously evolves through changes, and issue reports encapsulate these change requests. In the GitHub system, a labeling mechanism has been introduced for systematic issue management, but significant effort from developers is required to label and manage these issues. To address this, numerous attempts have been made in previous research to automate issue report classification. However, these attempts have shown limitations in classification accuracy. We experiment to determine if integrating heterogeneous information through a multimodal model that combines text, images, and code from issue reports can improve classification accuracy. Specifically, we investigate whether training the model on extensive issue data can enhance classification accuracy. Experimental results show that the multimodal approach outperforms single-modal models by 5.50-7.01% in terms of F1-Score, demonstrating superior performance. These findings indicate that leveraging heterogeneous data sources in issue reports is effective in improving classification performance.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3613404
Citations
1
Primary Topic
BIM and Construction Integration
Type
article
Field-Weighted Citation Impact
1.01
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multimodal Deep Learning Model for Cross-Project Issue Classification

Seonah Lee, Pilsu Jung, Changwon Kwak, Jueun Heo
1 citations
IEEE Access
BIM and Construction Integration
1.01
article

A Multimodal Deep Learning Model for Cross-Project Issue Classification

Seonah Lee, Pilsu Jung, Changwon Kwak, Jueun Heo
article en
1 citations

Abstract

Software continuously evolves through changes, and issue reports encapsulate these change requests. In the GitHub system, a labeling mechanism has been introduced for systematic issue management, but significant effort from developers is required to label and manage these issues. To address this, numerous attempts have been made in previous research to automate issue report classification. However, these attempts have shown limitations in classification accuracy. We experiment to determine if integrating heterogeneous information through a multimodal model that combines text, images, and code from issue reports can improve classification accuracy. Specifically, we investigate whether training the model on extensive issue data can enhance classification accuracy. Experimental results show that the multimodal approach outperforms single-modal models by 5.50-7.01% in terms of F1-Score, demonstrating superior performance. These findings indicate that leveraging heterogeneous data sources in issue reports is effective in improving classification performance.

IEEE AccessVol. 13
Gyeongsang National University (KR)
Openalex Percentile: Top 20%
BIM and Construction Integration
1.01
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.