LightGNN: Simple Graph Neural Network for Recommendation
Graph neural networks (GNNs) have demonstrated superior performance in collaborative recommendation through their ability to conduct high-order representation smoothing, effectively capturing structural information within users' interaction patterns. However, existing GNN paradigms face significant challenges in scalability and robustness when handling large-scale, noisy real-world datasets. To address these challenges, we present LightGNN, a lightweight and distillation-based GNN pruning framework designed to substantially reduce model complexity while preserving essential collaboration modeling capabilities. Our LightGNN framework introduces a computationally efficient pruning module that adaptively identifies and removes adverse edges and embedding entries for model compression. The framework is guided by a resource-friendly hierarchical knowledge distillation objective, whose intermediate layer augments the observed graph to maintain performance, particularly in high-rate compression scenarios. Extensive experiments on public datasets demonstrate LightGNN's effectiveness, significantly improving both computational efficiency and recommendation accuracy. Notably, LightGNN achieves an 80% reduction in edge count and 90% reduction in embedding entries while maintaining performance comparable to more complex state-of-the-art baselines. The implementation of our LightGNN model is available at the github repository: https://github.com/HKUDS/LightGNN.
Authors
- Guoxuan Chen (ORCID: https://orcid.org/0009-0006-5988-923X)
- Lianghao Xia (ORCID: https://orcid.org/0000-0003-0725-2211)
- Chao Huang (ORCID: https://orcid.org/0009-0003-3740-4500)
Institutions
- University of Hong Kong (HK)
Publication Details
- Published
- 2025-02-26
- DOI
- https://doi.org/10.1145/3701551.3703536
- Citations
- 8
- Primary Topic
- Recommender Systems and Techniques
- Type
- article
- Field-Weighted Citation Impact
- 25.97