Research on Low-Latency Inference and Training Efficiency Optimization for Graph Neural Network and Large Language Model-Based Recommendation Systems
The incessant advent of online services demands high speed and efficient recommender systems (ReS) that can maintain real-time performance along with processing very complex user-item interactions. The present study, therefore, considers computational bottlenecks involved in hybrid Graph Neural Network (GNN) and Large Language Model (LLM)-based ReS with the aim optimizing their inference latency and training efficiency. An extensive methodology was used: hybrid GNN-LLM integrated architecture-optimization strategies (quantization, LoRA, distillation)-hardware acceleration (FPGA, DeepSpeed)-all under R 4.4.2. Experimental improvements were significant, with the optimal Hybrid + FPGA + DeepSpeed configuration reaching 13.6 % more accuracy (NDCG@10: 0.75) at <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$40-60 ~\text{ms}$</tex> of latency, while LoRA brought down training time by <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$66 \%(3.8 \text{hours})$</tex> in comparison to the non-optimized baseline. Irrespective of domain, such as accuracy or efficiency, it can be established that hardwaresoftware co-design and parameter-efficient tuning permit hybrid models to outperform GNN or LLM approaches implemented independently. It recommends the use of FPGA as well as LoRA for real-time deployment. Future work should involve federated learning along with advanced fusion architectures for better scalability and privacy preservation. Thus, this research marks the fundamental groundwork concerning next-generation ReS balancing low-latency response with cutting-edge personalization.
Authors
- Haotian Lyu (ORCID: https://orcid.org/0009-0005-3225-8676)
- Y. X. Zhao
- Xinyue Han
- Feng Jiang (ORCID: https://orcid.org/0009-0002-4206-6377)
- A. Y. Sun (ORCID: https://orcid.org/0009-0007-5784-8167)
- Yike Peng
Institutions
- University of Southern California (US)
- Northeastern University (US)
- Washington University in St. Louis (US)
- Carnegie Mellon University (US)
- Columbia University (US)
Publication Details
- Published
- 2025-06-20
- DOI
- https://doi.org/10.1109/caibda65784.2025.11182947
- Citations
- 2
- Primary Topic
- Advanced Graph Neural Networks
- Type
- article
- Field-Weighted Citation Impact
- 4.96