On Large Language Model Based Joint Source Channel Coding for Semantic Communication
Deep learning is extensively proposed in Semantic Communication (SemCom) for semantic extraction and optimization, but often requires complex, application-specific neural networks and struggles with generalization to new environments. Building on the success of large language models (LLMs), this paper explores the adaptability of LLMs to a more efficient and generalizable SemCom design. We introduce SemComLLM and demonstrate its viability by integrating the Llama-2 model with Joint Source-Channel Coding (JSCC), enhancing transmission efficiency and semantic accuracy. The empirical results show an improved contextual understanding. We discuss key challenges and develop future research directions for further refinement.
Authors
- Shiva Raj Pokhrel (ORCID: https://orcid.org/0000-0001-5819-765X)
- Anwar Walid (ORCID: https://orcid.org/0000-0003-1992-6068)
Institutions
- Deakin University (AU)
- Columbia University (US)
Publication Details
- Published
- 2024-11-26
- DOI
- https://doi.org/10.1109/fllm63129.2024.10852431
- Citations
- 4
- Primary Topic
- Advanced Data Compression Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.00
Funders
- Deakin University