Leveraging Pre-Trained Large Language Models for CSI Feedback in Massive MIMO Systems

Large language models (LLMs) have revolutionized natural language processing by learning rich representations from massive and diverse text data. While pre-trained LLMs have been widely customized for a variety of text-related tasks, their potential in wireless communications remains largely untapped. In this paper, we propose a novel channel state information (CSI) feedback framework for massive multiple-input multiple-output (MIMO) systems that leverages pre-trained LLMs to bridge the gap between natural language processing and wireless communication. To adapt LLMs for the CSI feedback task, we design specialized pre-processing, embedding, and post-processing modules that convert CSI data into token representations compatible with LLMs. Moreover, to address the limitations of a single model and enhance performance in diverse environments and under various compression ratios, we introduce a mixture-of-agents (MoA)based framework that integrates the complementary strengths of multiple LLMs. Simulation results demonstrate that our approach achieves superior CSI reconstruction performance, robust generalization to unseen scenarios, and significant training cost reduction even with limited data. These findings confirm that the transferable knowledge acquired from large-scale natural language pre-training can effectively enhance CSI feedback, offering a promising direction for intelligent and efficient nextgeneration wireless communication systems.

Authors

Publication Details

Published
2025-07-19
DOI
https://doi.org/10.36227/techrxiv.175289012.28506097/v1
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging Pre-Trained Large Language Models for CSI Feedback in Massive MIMO Systems

Shi Jin, Chao-Kai Wen, Jiajia Guo, Yiming Cui et al.
Speech Recognition and Synthesis
article

Leveraging Pre-Trained Large Language Models for CSI Feedback in Massive MIMO Systems

Shi Jin, Chao-Kai Wen, Jiajia Guo, Yiming Cui, E. C. Tong
article en

Abstract

Large language models (LLMs) have revolutionized natural language processing by learning rich representations from massive and diverse text data. While pre-trained LLMs have been widely customized for a variety of text-related tasks, their potential in wireless communications remains largely untapped. In this paper, we propose a novel channel state information (CSI) feedback framework for massive multiple-input multiple-output (MIMO) systems that leverages pre-trained LLMs to bridge the gap between natural language processing and wireless communication. To adapt LLMs for the CSI feedback task, we design specialized pre-processing, embedding, and post-processing modules that convert CSI data into token representations compatible with LLMs. Moreover, to address the limitations of a single model and enhance performance in diverse environments and under various compression ratios, we introduce a mixture-of-agents (MoA)based framework that integrates the complementary strengths of multiple LLMs. Simulation results demonstrate that our approach achieves superior CSI reconstruction performance, robust generalization to unseen scenarios, and significant training cost reduction even with limited data. These findings confirm that the transferable knowledge acquired from large-scale natural language pre-training can effectively enhance CSI feedback, offering a promising direction for intelligent and efficient nextgeneration wireless communication systems.

Openalex Percentile: Top 90%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Leveraging Pre-Trained Large Language Models for CSI Feedback in Massive MIMO Systems — Shi Jin, Chao-Kai Wen, et al. · (2025) | TGRS Research Map | TGRS