Adaptive Bitrate Video Semantic Increment Transmission System Based on Buffer and Semantic Importance

Significant progress has been made in researching video semantic communication technology and adaptive bitrate (ABR) algorithms. However, wireless network fluctuations challenge video semantic communication systems without ABR algorithms to achieve a satisfactory balance between high semantic recovery accuracy and efficient bandwidth utilization. This paper proposes an adaptive bitrate video semantic increment transmission system based on buffer and semantic importance to address this issue. Firstly, a buffer-based video semantic increment transmission system is designed to dynamically adjust the amount of video semantic data transmitted by the transmitter based on network fluctuations. Then, a novel Deep Learning and Reinforcement Learning based ABR algorithm (DR-ABR) is developed to determine the optimal video incremental ratio under the current network conditions. Furthermore, a semantic feature compression technology based on semantic importance is proposed to compress the video data according to the abovementioned ratio. Experimental results demonstrate that the proposed method outperforms traditional approaches in terms of video semantic transmission performance.