Imbalanced graph learning via mixed entropy minimization

Imbalanced datasets, where the minority class is underrepresented, pose significant challenges for node classification in graph learning. Traditional methods often address this issue through synthetic oversampling techniques for the minority class, which can complicate the training process. To address these challenges, we introduce a novel training paradigm for node classification on imbalanced graphs, based on mixed entropy minimization (ME). Our proposed method, GraphME, offers a 'free imbalance defense' against class imbalance without requiring additional steps to improve classification performance. ME aims to achieve the same goal as cross-entropy-maximizing the model's probability for the correct classes-while effectively reducing the impact of incorrect class probabilities through a "guidance" term that ensures a balanced trade-off. We validate the effectiveness of our approach through experiments on multiple datasets, where GraphME consistently outperforms the traditional cross-entropy objective, demonstrating enhanced robustness. Moreover, our method can be seamlessly integrated with various adversarial training techniques, leading to substantial improvements in robustness. Notably, GraphME enhances classification accuracy without compromising efficiency, a significant improvement over existing methods. The GraphME code is available at: https://github.com/12chen20/GraphME .

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2024-10-22
DOI
https://doi.org/10.1038/s41598-024-75999-6
Citations
3
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
1.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Imbalanced graph learning via mixed entropy minimization

Jiali Chen, Liwen Xu, Huaguang Zhu
3 citations
Scientific Reports
Imbalanced Data Classification Techniques
1.04
article

Imbalanced graph learning via mixed entropy minimization

Jiali Chen, Liwen Xu, Huaguang Zhu
article en
3 citations

Abstract

Imbalanced datasets, where the minority class is underrepresented, pose significant challenges for node classification in graph learning. Traditional methods often address this issue through synthetic oversampling techniques for the minority class, which can complicate the training process. To address these challenges, we introduce a novel training paradigm for node classification on imbalanced graphs, based on mixed entropy minimization (ME). Our proposed method, GraphME, offers a 'free imbalance defense' against class imbalance without requiring additional steps to improve classification performance. ME aims to achieve the same goal as cross-entropy-maximizing the model's probability for the correct classes-while effectively reducing the impact of incorrect class probabilities through a "guidance" term that ensures a balanced trade-off. We validate the effectiveness of our approach through experiments on multiple datasets, where GraphME consistently outperforms the traditional cross-entropy objective, demonstrating enhanced robustness. Moreover, our method can be seamlessly integrated with various adversarial training techniques, leading to substantial improvements in robustness. Notably, GraphME enhances classification accuracy without compromising efficiency, a significant improvement over existing methods. The GraphME code is available at: https://github.com/12chen20/GraphME .

Scientific ReportsVol. 14(1)
North China University of Technology (CN), Southwestern University of Finance and Economics (CN)
National Social Science Fund of China
Openalex Percentile: Top 19%
Imbalanced Data Classification Techniques
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.