RISE: Multi-Link Proactive Low-Latency Video Streaming for Teleoperation in Fading Channels

Throughput-critical applications, such as teleoperation, require robust and low-latency communication systems to ensure seamless performance. In this work, we propose the opensource predictive multi-link teleoperation video stream system for fading channels called Reliable Intelligent Stream Encoding system (RISE). It features a proactive bitrate control based on predicted channel conditions together with a modified version of the SEAMLESS multi-link protocol. Additionally, video stream queue feedback is evaluated to dynamically adjust the bitrate if predictions are too optimistic. Thereby, video transmission delays are minimized, preventing video frame drops due to an unacceptable age-of-information. We validate the performance of RISE in a laboratory setup using realistic radio channel emulation. The results demonstrate significant latency and video frame delivery improvements compared to conventional singlelink and constant bitrate approaches. By leveraging SEAMLESS in addition to using the predicted bitrate with queue feedback approach, the median data rate of the video stream was doubled. Furthermore, RISE prevents frame drops in all investigated channel configurations while minimizing the queue delay. Thus, the proposed approach demonstrates the potential for improvement in the overall reliability of real-world teleoperation systems.