Research on information interaction between VR and binocular cameras based on teleoperation technology

The operator wears a VR device to directly control the robot's movements. The robot is located in a production and processing environment, performing tasks through tools installed at its end. Binocular cameras are installed in the scene to capture real-time images of the task being processed. These images are enhanced using image enhancement algorithms and displayed through the VR goggles. The binocular cameras have an interocular distance and field of view similar to human eyes, creating binocular vision in the VR goggles, which gives the operator a sense of depth perception. Based on visual feedback, The operator makes decisions in their mind, controls arm movements, and uses a VR handle to track hand positions, thereby controlling the robot's arm movements in real time. Using VR/AR technology, robots can execute tasks in challenging environments while incorporating human decision-making, thus employing teleoperation technology to integrate the robot with the operator. This addresses the issue of relying solely on artificial intelligence for autonomous decision-making. This paper explores the information exchange between binocular cameras and VR devices in teleoperation technology. It addresses the different coordinate systems within the robotic system by performing coordinate transformations. Combining these transformations, it achieves VR handle pose and virtual ray display, thereby improving the efficiency of operators in completing human-robot interaction tasks. This introduces a novel method for transforming traditional industrial robots.