On Large Language Model Based Joint Source Channel Coding for Semantic Communication

Deep learning is extensively proposed in Semantic Communication (SemCom) for semantic extraction and optimization, but often requires complex, application-specific neural networks and struggles with generalization to new environments. Building on the success of large language models (LLMs), this paper explores the adaptability of LLMs to a more efficient and generalizable SemCom design. We introduce SemComLLM and demonstrate its viability by integrating the Llama-2 model with Joint Source-Channel Coding (JSCC), enhancing transmission efficiency and semantic accuracy. The empirical results show an improved contextual understanding. We discuss key challenges and develop future research directions for further refinement.

Authors

Institutions

Publication Details

Published
2024-11-26
DOI
https://doi.org/10.1109/fllm63129.2024.10852431
Citations
4
Primary Topic
Advanced Data Compression Techniques
Type
article
Field-Weighted Citation Impact
1.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On Large Language Model Based Joint Source Channel Coding for Semantic Communication

Shiva Raj Pokhrel, Anwar Walid
4 citations
Advanced Data Compression Techniques
1.00
article

On Large Language Model Based Joint Source Channel Coding for Semantic Communication

Shiva Raj Pokhrel, Anwar Walid
article en
4 citations

Abstract

Deep learning is extensively proposed in Semantic Communication (SemCom) for semantic extraction and optimization, but often requires complex, application-specific neural networks and struggles with generalization to new environments. Building on the success of large language models (LLMs), this paper explores the adaptability of LLMs to a more efficient and generalizable SemCom design. We introduce SemComLLM and demonstrate its viability by integrating the Llama-2 model with Joint Source-Channel Coding (JSCC), enhancing transmission efficiency and semantic accuracy. The empirical results show an improved contextual understanding. We discuss key challenges and develop future research directions for further refinement.

Deakin University (AU), Columbia University (US)
Deakin University
Openalex Percentile: Top 21%
Advanced Data Compression Techniques
1.00
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.