Imbalanced data prediction model based on self-attention mechanism and generative adversarial network

Imbalanced data distribution causes the traditional machine learning classification algorithms to be affected by the characteristics of the majority class, resulting in poor classification performance for the minority-class data. To improve the classification accuracy of minority classes in imbalanced data, this study has proposed a novel model—a generative adversarial network with self-attention mechanism oversampling based on a convolutional neural network (GAN-SAMO-CNN). The self-attention mechanism (SAM) of this model focused on the correlations among data elements of the minority class. The degree of correlation was first obtained by calculating the attention scores, which enabled the effective extraction of the distribution characteristics of the data. Subsequently, a generative adversarial network (GAN) was used to generate samples with high similarity to reduce data imbalances. Finally, a CNN classification model was constructed to train and predict the samples. The experimental results showed that the F1-score , G-mean , and area under PRC curve ( AUPRC ) of the model were considerably better than those of the other imbalanced data classification methods. The proposed method was then validated using multiple independent test datasets to demonstrate the model's generalizability and robustness.

Authors

Institutions

Publication Details

Journal
Intelligent Data Analysis
Published
2025-01-22
DOI
https://doi.org/10.1177/1088467x241301698
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Imbalanced data prediction model based on self-attention mechanism and generative adversarial network

Dongyan Ding, Fengxin Zhang, Dechang Pi, Hui Li
1 links
Intelligent Data Analysis
Imbalanced Data Classification Techniques
article

Imbalanced data prediction model based on self-attention mechanism and generative adversarial network

Dongyan Ding, Fengxin Zhang, Dechang Pi, Hui Li
article en

Abstract

Imbalanced data distribution causes the traditional machine learning classification algorithms to be affected by the characteristics of the majority class, resulting in poor classification performance for the minority-class data. To improve the classification accuracy of minority classes in imbalanced data, this study has proposed a novel model—a generative adversarial network with self-attention mechanism oversampling based on a convolutional neural network (GAN-SAMO-CNN). The self-attention mechanism (SAM) of this model focused on the correlations among data elements of the minority class. The degree of correlation was first obtained by calculating the attention scores, which enabled the effective extraction of the distribution characteristics of the data. Subsequently, a generative adversarial network (GAN) was used to generate samples with high similarity to reduce data imbalances. Finally, a CNN classification model was constructed to train and predict the samples. The experimental results showed that the F1-score , G-mean , and area under PRC curve ( AUPRC ) of the model were considerably better than those of the other imbalanced data classification methods. The proposed method was then validated using multiple independent test datasets to demonstrate the model's generalizability and robustness.

Intelligent Data AnalysisVol. 29(5)
Hohai University (CN), Jinling Institute of Technology (CN), Nanjing University of Aeronautics and Astronautics (CN)
Openalex Percentile: Top 87%
Imbalanced Data Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Imbalanced data prediction model based on self-attention mechanism and generative adversarial network — Dongyan Ding, Fengxin Zhang, et al. · Intelligent Data Analysis (2025) | TGRS Research Map | TGRS