Multi-Dimensional Representation for Semantic Communication: A New Horizon for Customized Visualization of Shared Knowledge

Semantic communication plays a crucial role in human interactions, allowing for the exchange of complex ideas and concepts. In this paper, we introduce a novel approach to semantic communication leveraging image generative Artificial Intelligence (AI) models, specifically stable diffusion models. Unlike conventional works, our system enables the transmission of images through a physical channel by transforming them into multi-dimensional semantic representations consisting of text descriptions, low-resolution sketches, and pose information. At the receiver’s end, these semantic representations are used to reconstruct the original image using a trained stable diffusion model. The benefits of our approach include reduced transmission bandwidth requirements, flexibility in reconstruction styles, adaptability to multiple receivers’ preferences, and the ability to omit unwanted image elements. We present preliminary results demonstrating the feasibility and effectiveness of our method. The similarity score between the transmitted images and reconstructed ones reach values ranging between 0.015 and 0.029 in Root Mean Square Error (RMSE) and between 0.993 and 0.998 using a Siamese network.