Virtual Reality-Based Teleoperation System for Robot Forklifts

The growing reliance on e-commerce and the demand for efficient intralogistics operations have increased the need for automation, while labour shortages continue to pose significant challenges. When combined with the inherent risks of forklift operation, this circumstance prompted businesses to look for robotic solutions for intralogistics tasks. However, robots are still limited when they come across situations that are outside of their programming scope and often need assistance from humans. To achieve the long-term goal of enhancing intralogistics operation, we propose the development of a virtual reality-based teleoperation system that allows remote operation of robot forklifts with minimal latency. Considering the specificities of the teleoperation process and network dynamics, we conduct detailed modelling to analyse latency factors, optimise system performance, and ensure a seamless user experience. Experimental results on a mobile robot have shown that the proposed teleoperation system achieves an average glass-to-glass latency of 368 ms, with capturing latency contributing to approximately 60% of the total delay. The results also indicate that network os-cillations significantly impact image quality and user experience, emphasising the importance of a stable network infrastructure.