Leveraging Pre-Trained Large Language Models for CSI Feedback in Massive MIMO Systems
Large language models (LLMs) have revolutionized natural language processing by learning rich representations from massive and diverse text data. While pre-trained LLMs have been widely customized for a variety of text-related tasks, their potential in wireless communications remains largely untapped. In this paper, we propose a novel channel state information (CSI) feedback framework for massive multiple-input multiple-output (MIMO) systems that leverages pre-trained LLMs to bridge the gap between natural language processing and wireless communication. To adapt LLMs for the CSI feedback task, we design specialized pre-processing, embedding, and post-processing modules that convert CSI data into token representations compatible with LLMs. Moreover, to address the limitations of a single model and enhance performance in diverse environments and under various compression ratios, we introduce a mixture-of-agents (MoA)based framework that integrates the complementary strengths of multiple LLMs. Simulation results demonstrate that our approach achieves superior CSI reconstruction performance, robust generalization to unseen scenarios, and significant training cost reduction even with limited data. These findings confirm that the transferable knowledge acquired from large-scale natural language pre-training can effectively enhance CSI feedback, offering a promising direction for intelligent and efficient nextgeneration wireless communication systems.
Authors
- Shi Jin (ORCID: https://orcid.org/0000-0003-0271-6021)
- Chao-Kai Wen (ORCID: https://orcid.org/0000-0001-5952-232X)
- Jiajia Guo (ORCID: https://orcid.org/0000-0002-6220-2295)
- Yiming Cui (ORCID: https://orcid.org/0000-0003-1644-6499)
- E. C. Tong
Publication Details
- Published
- 2025-07-19
- DOI
- https://doi.org/10.36227/techrxiv.175289012.28506097/v1
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00