Cross-Modal Semantic Communication for Text-to-Video Retrieval in Internet of Vehicles

Text-to-video retrieval offers an intelligent solution for Internet of Vehicles (IoV) users to access desired content on demand. However, the constrained communication channels in IoV, characterized by low signal-to-noise ratios (SNR), pose significant obstacles to retrieval performance. To tackle these issues, this study presents SemTVR, a semantic communication framework dedicated to achieving superior robustness in text-to-video retrieval tasks in low-SNR IoV environments. By integrating the semantic communication paradigm with edge–cloud collaboration, our architecture leverages roadside unit (RSU) features and cloud resources to enable collaborative retrieval. We introduce a multi-semantic interactive reliable transmission mechanism that utilizes historical search records to enhance semantic recovery accuracy under adverse channel conditions. Furthermore, we devise a cross-modal fine-grained matching strategy assigning differentiated weights to video content and query sentences. Experimental results conducted on authoritative datasets demonstrate that SemTVR significantly outperforms baseline methods in terms of search accuracy, particularly in low SNR scenarios, validating its effectiveness for future IoV applications.