A Survey on Computational Efficiency Optimization for Graph Neural Networks on Large-Scale Graphs

Graph Neural Networks (GNNs) have become a dominant paradigm for learning from graph-structured data, yet their application to large-scale graphs remains constrained by three coupled system bottlenecks: memory, computation, and communication. This paper organizes the literature around a bottleneck-centric taxonomy that maps representative techniques, including Cluster-GCN, GraphSAINT, GraphSAGE, SGC, DistDGL, and AliGraph, to the specific constraint each primarily relieves. Three representative systems, GraphSAGE, Cluster-GCN, and DistDGL, are further analyzed as case studies and consolidated into a practical decision matrix linking graph scale, hardware budget, and structural properties to an appropriate strategy. The paper also identifies a largely unaddressed challenge: the shift toward high-dimensional, LLM-encoded node features, which is beginning to move the dominant bottleneck from computation toward memory bandwidth and I/O. The review concludes that current sampling and partitioning techniques remain vulnerable to long-tail bias, that reported near-linear distributed speedups depend on network conditions rarely disclosed in published work, and that the most promising direction for future systems lies not in a new algorithm but in adaptive schedulers that reconfigure strategy at runtime.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2026-11-03
DOI
https://doi.org/10.54254/2755-2721/2026.38493
Primary Topic
Graph Theory and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Survey on Computational Efficiency Optimization for Graph Neural Networks on Large-Scale Graphs

Jiahao Wan
Applied and Computational Engineering
Graph Theory and Algorithms
article

A Survey on Computational Efficiency Optimization for Graph Neural Networks on Large-Scale Graphs

Jiahao Wan
article en

Abstract

Graph Neural Networks (GNNs) have become a dominant paradigm for learning from graph-structured data, yet their application to large-scale graphs remains constrained by three coupled system bottlenecks: memory, computation, and communication. This paper organizes the literature around a bottleneck-centric taxonomy that maps representative techniques, including Cluster-GCN, GraphSAINT, GraphSAGE, SGC, DistDGL, and AliGraph, to the specific constraint each primarily relieves. Three representative systems, GraphSAGE, Cluster-GCN, and DistDGL, are further analyzed as case studies and consolidated into a practical decision matrix linking graph scale, hardware budget, and structural properties to an appropriate strategy. The paper also identifies a largely unaddressed challenge: the shift toward high-dimensional, LLM-encoded node features, which is beginning to move the dominant bottleneck from computation toward memory bandwidth and I/O. The review concludes that current sampling and partitioning techniques remain vulnerable to long-tail bias, that reported near-linear distributed speedups depend on network conditions rarely disclosed in published work, and that the most promising direction for future systems lies not in a new algorithm but in adaptive schedulers that reconfigure strategy at runtime.

Applied and Computational EngineeringVol. 280(1)
University of Nottingham Ningbo China (CN)
Openalex Percentile: Top 19%
Graph Theory and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon