GLADC: Global Linear Attention and Dual Constraint for Mitigating Over-Smoothing in Graph Neural Networks

Graph Convolutional Networks (GCNs) enhance node representations by aggregating information from neighboring nodes, but deeper layers often suffer from over-smoothing, where node embeddings become indistinguishable. Transformers enable global dependency modeling on graphs but suffer from high computational costs and can exacerbate over-smoothing when multiple attention layers are stacked. To address these issues, we propose GLADC, a novel framework designed for semi-supervised node classification. It integrates global linear attention for efficient long-range dependency capture and a dual constraint module for local propagation. The dual constraint consists of (1) column-wise random masking on the representation matrix to dynamically limit redundant information aggregation, and (2) row-wise contrastive constraint to explicitly increase inter-node distance and preserve distinctiveness. This design achieves linear-complexity global mixing while effectively countering representation homogenization. Extensive evaluations on seven real-world datasets demonstrate that GLADC delivers competitive performance and maintains robustness in deep architectures (up to 32 layers). An ablation study further confirms the synergistic effect of both constraints in alleviating over-smoothing and preventing premature convergence.

Authors

Institutions

Publication Details

Journal
Algorithms
Published
2025-11-25
DOI
https://doi.org/10.3390/a18120739
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GLADC: Global Linear Attention and Dual Constraint for Mitigating Over-Smoothing in Graph Neural Networks

Hanning Chen, Zepeng Chen, Yang Yan, Qiuyan Wang
Algorithms
Advanced Graph Neural Networks
article

GLADC: Global Linear Attention and Dual Constraint for Mitigating Over-Smoothing in Graph Neural Networks

Hanning Chen, Zepeng Chen, Yang Yan, Qiuyan Wang
article en

Abstract

Graph Convolutional Networks (GCNs) enhance node representations by aggregating information from neighboring nodes, but deeper layers often suffer from over-smoothing, where node embeddings become indistinguishable. Transformers enable global dependency modeling on graphs but suffer from high computational costs and can exacerbate over-smoothing when multiple attention layers are stacked. To address these issues, we propose GLADC, a novel framework designed for semi-supervised node classification. It integrates global linear attention for efficient long-range dependency capture and a dual constraint module for local propagation. The dual constraint consists of (1) column-wise random masking on the representation matrix to dynamically limit redundant information aggregation, and (2) row-wise contrastive constraint to explicitly increase inter-node distance and preserve distinctiveness. This design achieves linear-complexity global mixing while effectively countering representation homogenization. Extensive evaluations on seven real-world datasets demonstrate that GLADC delivers competitive performance and maintains robustness in deep architectures (up to 32 layers). An ablation study further confirms the synergistic effect of both constraints in alleviating over-smoothing and preventing premature convergence.

AlgorithmsVol. 18(12)
Tianjin University of Science and Technology (CN), Tianjin University of Technology and Education (CN), Tiangong University (CN), Putian University (CN)
Openalex Percentile: Top 81%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

GLADC: Global Linear Attention and Dual Constraint for Mitigating Over-Smoothing in Graph Neural Networks — Hanning Chen, Zepeng Chen, et al. · Algorithms (2025) | TGRS Research Map | TGRS