Semantic Communication Based on Content Style Adaptation for Image Transmission

The development of semantic communication has promoted the research on image transmission. Content and style are two crucial characteristics of image information. Existing studies have explored image information transmission and recovery methods in semantic communication systems, but do not consider both image style information and content information simultaneously. To address this issue, based on deep joint source-channel coding (JSCC) structure, a novel system named semantic communication based on content style adaption (CSASC) for image transmission is proposed in this paper. Specifically, a novel semantic information extraction method are designed to extract the semantic content information and semantic style information of images, meanwhile an image content-style adaptive reconstruction method is proposed by fusing semantic content and semantic style features to improve the image reconstruction accuracy. In addition, the impact of the weighting of semantic style and content information on image reconstruction quality is analyzed. Results demonstrate that the proposed method has better recovery results compared with existing image semantic communication methods.

Authors

Institutions

Publication Details

Published
2024-10-24
DOI
https://doi.org/10.1109/wcsp62071.2024.10826986
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Semantic Communication Based on Content Style Adaptation for Image Transmission

Nan Ma, Lixin Shen, Mengshu Song, Yiming Liu et al.
Image Retrieval and Classification Techniques
article

Semantic Communication Based on Content Style Adaptation for Image Transmission

Nan Ma, Lixin Shen, Mengshu Song, Yiming Liu, Chen Dong
article en

Abstract

The development of semantic communication has promoted the research on image transmission. Content and style are two crucial characteristics of image information. Existing studies have explored image information transmission and recovery methods in semantic communication systems, but do not consider both image style information and content information simultaneously. To address this issue, based on deep joint source-channel coding (JSCC) structure, a novel system named semantic communication based on content style adaption (CSASC) for image transmission is proposed in this paper. Specifically, a novel semantic information extraction method are designed to extract the semantic content information and semantic style information of images, meanwhile an image content-style adaptive reconstruction method is proposed by fusing semantic content and semantic style features to improve the image reconstruction accuracy. In addition, the impact of the weighting of semantic style and content information on image reconstruction quality is analyzed. Results demonstrate that the proposed method has better recovery results compared with existing image semantic communication methods.

Beijing University of Posts and Telecommunications (CN), State Key Laboratory of Networking and Switching Technology
National Natural Science Foundation of China
Openalex Percentile: Top 75%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.