Layer-Adaptive-Augmentation-Based Graph Contrastive Learning With Feature Decorrelation

Graph Contrastive Learning (GCL) methods typically leverage augmentation techniques to generate different graph views for comparison, thereby learning corresponding representations for graph-related tasks in label-scarce scenarios. However, existing GCL methods suffer from two primary limitations: 1) they use predefined or one-time perturbations for augmentation, ignoring adaptive noise injection during forward propagation and thus leading to suboptimal model robustness; 2) their contrast mechanisms mainly focus on the agreement of inter-graph representations while neglecting the dimensional feature redundancy within intra-graph representations. To solve these issues, we propose Layer-adaptive-augmentation-based Graph Contrastive Learning with feature Decorrelation (LGCLD). First, the designed layer-wise adaptive augmentation method performs dynamic perturbations while maintaining the semantic similarity between augmented and original graphs, which can improve model robustness. Second, we introduce an Agreement-Decorrelation loss (AD loss) that simultaneously optimizes the agreement between graph-level representations and the feature correlation among different dimensions within each graph-level representation, promoting the model to learn informative and non-redundant graph-level representations. Furthermore, we analyze the reasonableness of AD loss through the graph information bottleneck principle. Experiments on various-domain graph datasets demonstrate that LGCLD achieves better or competitive performance compared with a series of state-of-the-art baselines.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2025-10-07
DOI
https://doi.org/10.1109/tpami.2025.3618329
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Layer-Adaptive-Augmentation-Based Graph Contrastive Learning With Feature Decorrelation

Yuhua Xu, Changjun Jiang, Rui Duan, Junli Wang
IEEE Transactions on Pattern Analysis and Machine Intelligence
Advanced Graph Neural Networks
article

Layer-Adaptive-Augmentation-Based Graph Contrastive Learning With Feature Decorrelation

Yuhua Xu, Changjun Jiang, Rui Duan, Junli Wang
article en

Abstract

Graph Contrastive Learning (GCL) methods typically leverage augmentation techniques to generate different graph views for comparison, thereby learning corresponding representations for graph-related tasks in label-scarce scenarios. However, existing GCL methods suffer from two primary limitations: 1) they use predefined or one-time perturbations for augmentation, ignoring adaptive noise injection during forward propagation and thus leading to suboptimal model robustness; 2) their contrast mechanisms mainly focus on the agreement of inter-graph representations while neglecting the dimensional feature redundancy within intra-graph representations. To solve these issues, we propose Layer-adaptive-augmentation-based Graph Contrastive Learning with feature Decorrelation (LGCLD). First, the designed layer-wise adaptive augmentation method performs dynamic perturbations while maintaining the semantic similarity between augmented and original graphs, which can improve model robustness. Second, we introduce an Agreement-Decorrelation loss (AD loss) that simultaneously optimizes the agreement between graph-level representations and the feature correlation among different dimensions within each graph-level representation, promoting the model to learn informative and non-redundant graph-level representations. Furthermore, we analyze the reasonableness of AD loss through the graph information bottleneck principle. Experiments on various-domain graph datasets demonstrate that LGCLD achieves better or competitive performance compared with a series of state-of-the-art baselines.

IEEE Transactions on Pattern Analysis and Machine IntelligenceVol. 48(2)
Tongji University (CN), Donghua University (CN), Guangzhou University (CN)
Openalex Percentile: Top 85%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.