Semantics Guided Diffusion for Deep Joint Source and Channel Coding Design

Semantic communication (SemCom) offers a promising avenue for enhancing transmission efficiency, especially as traditional bit-level communication approaches its theoretical limits. A key enabling technology in SemCom is deep learning-based joint source and channel coding (DeepJSCC). However, existing DeepJSCC methods lack interpretability because they transmit semantic information implicitly by mapping data to latent features. Additionally, the black-box nature of neural networks makes it challenging to ensure the reliable transmission of critical semantics. To address these challenges, we propose advancing DeepJSCC towards a more “semantic” approach. Specifically, we suggest transmitting interpretable and lightweight semantics as side information alongside JSCC latent features. At the receiver end, we introduce a novel latent diffusion model designed for wireless communication, trained from scratch to integrate seamlessly with DeepJSCC. Using the semantic side information, the receiver employs the proposed semantics-guided latent diffusion for denoising. Furthermore, since accurate channel state information (CSI) is essential in practice, we propose estimating CSI directly from the channel output. The estimated CSI is then used for step matching in the denoising diffusion process, enabling CSI-free transmission. Finally, the denoised feature is fed into the JSCC decoder to reconstruct the image. Numerical results demonstrate that our proposed scheme can achieve comparable performance without accurate CSI. Additionally, guided by semantic information and leveraging the powerful diffusion model, our method surpasses current DeepJSCC schemes, delivering satisfactory reconstruction performance even at SNR = −5dB. This proposed scheme highlights the potential of incorporating diffusion models in future SemCom systems and suggests several promising applications.

Authors

Institutions

Publication Details

Published
2024-10-24
DOI
https://doi.org/10.1109/wcsp62071.2024.10826825
Citations
2
Primary Topic
Advanced Data Compression Techniques
Type
article
Field-Weighted Citation Impact
0.50

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Semantics Guided Diffusion for Deep Joint Source and Channel Coding Design

Guangxu Zhu, Kaifeng Han, Richeng Jin, Xiaoming Chen et al.
2 citations
Advanced Data Compression Techniques
0.50
article

Semantics Guided Diffusion for Deep Joint Source and Channel Coding Design

Guangxu Zhu, Kaifeng Han, Richeng Jin, Xiaoming Chen, Maojun Zhang
article en
2 citations

Abstract

Semantic communication (SemCom) offers a promising avenue for enhancing transmission efficiency, especially as traditional bit-level communication approaches its theoretical limits. A key enabling technology in SemCom is deep learning-based joint source and channel coding (DeepJSCC). However, existing DeepJSCC methods lack interpretability because they transmit semantic information implicitly by mapping data to latent features. Additionally, the black-box nature of neural networks makes it challenging to ensure the reliable transmission of critical semantics. To address these challenges, we propose advancing DeepJSCC towards a more “semantic” approach. Specifically, we suggest transmitting interpretable and lightweight semantics as side information alongside JSCC latent features. At the receiver end, we introduce a novel latent diffusion model designed for wireless communication, trained from scratch to integrate seamlessly with DeepJSCC. Using the semantic side information, the receiver employs the proposed semantics-guided latent diffusion for denoising. Furthermore, since accurate channel state information (CSI) is essential in practice, we propose estimating CSI directly from the channel output. The estimated CSI is then used for step matching in the denoising diffusion process, enabling CSI-free transmission. Finally, the denoised feature is fed into the JSCC decoder to reconstruct the image. Numerical results demonstrate that our proposed scheme can achieve comparable performance without accurate CSI. Additionally, guided by semantic information and leveraging the powerful diffusion model, our method surpasses current DeepJSCC schemes, delivering satisfactory reconstruction performance even at SNR = −5dB. This proposed scheme highlights the potential of incorporating diffusion models in future SemCom systems and suggests several promising applications.

Shenzhen Research Institute of Big Data (CN), China Academy of Information and Communications Technology (CN), Zhejiang University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 32%
Advanced Data Compression Techniques
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.