Evolving Semantic Communication with Generative Modelling

Learning-based semantic communication (SemCom) has emerged as a promising solution for the upcoming 6G networks. In this paper, we explore an evolving SemCom system for image transmission, which can continuously adapt and enhance its transmission efficiency by exploiting knowledge accumulated during previous transmissions. Specifically, we propose a novel channel-aware semantic encoder that utilizes a pretrained generative model to extract channel-correlated latent variables consisting of several semantic vectors from the input images, which can be directly transmitted over a noisy channel without further channel coding. Moreover, we introduce a dynamic code construction mechanism that dynamically updates the codebook with transmitted semantic vectors to eliminate the need to transmit similar codes in subsequent transmissions, thus further reducing the communication overhead. Simulation results highlight the evolving performance of the proposed system in terms of transmission efficiency, achieving superior perceptual quality with an average bandwidth compression ratio (BCR) of $1 / 192$ for a sequence of 100 test images compared to DeepJSCC and InverseJSCC. Code used in this paper is available at https://github.com/recusant7/GAN_SeCom.

Authors

Institutions

Publication Details

Published
2024-09-02
DOI
https://doi.org/10.1109/pimrc59610.2024.10817276
Citations
6
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
2.08
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evolving Semantic Communication with Generative Modelling

Denız Gündüz, Shunpu Tang, Qianqian Yang, Zhaoyang Zhang
6 citations
Semantic Web and Ontologies
2.08
article

Evolving Semantic Communication with Generative Modelling

Denız Gündüz, Shunpu Tang, Qianqian Yang, Zhaoyang Zhang
article en
6 citations

Abstract

Learning-based semantic communication (SemCom) has emerged as a promising solution for the upcoming 6G networks. In this paper, we explore an evolving SemCom system for image transmission, which can continuously adapt and enhance its transmission efficiency by exploiting knowledge accumulated during previous transmissions. Specifically, we propose a novel channel-aware semantic encoder that utilizes a pretrained generative model to extract channel-correlated latent variables consisting of several semantic vectors from the input images, which can be directly transmitted over a noisy channel without further channel coding. Moreover, we introduce a dynamic code construction mechanism that dynamically updates the codebook with transmitted semantic vectors to eliminate the need to transmit similar codes in subsequent transmissions, thus further reducing the communication overhead. Simulation results highlight the evolving performance of the proposed system in terms of transmission efficiency, achieving superior perceptual quality with an average bandwidth compression ratio (BCR) of $1 / 192$ for a sequence of 100 test images compared to DeepJSCC and InverseJSCC. Code used in this paper is available at https://github.com/recusant7/GAN_SeCom.

Imperial College London (GB), Zhejiang University (CN)
Openalex Percentile: Top 11%
Semantic Web and Ontologies
2.08
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Evolving Semantic Communication with Generative Modelling — Denız Gündüz, Shunpu Tang, et al. · (2024) | TGRS Research Map | TGRS