ENHANCING VIRTUAL REALITY PRODUCT INTERACTION THROUGH REAL-TIME 3D SCENE PERCEPTION AND MULTI-MODAL INTERACTION

The advancement of technology has spurred the development of numerous techniques for simulating real products in 3D virtual environments.However, traditional Virtual Reality (VR) product interaction systems mainly promote interaction in 2D scenes, resulting in unsatisfactory interaction experiences in 3D settings.To address this issue, this study proposes a new design method for a VR product interaction system that utilizes real-time 3D scene perception.This method constructs a 3D model through 3D scene perception and extracts relevant object information.Multi-modal interaction techniques are employed to gather product interaction data from users' various sensory inputs.The experimental results showed that the proposed system achieved a low system occupancy rate of 0.06%, which was superior to other VR product interaction systems.With the increase of product interaction data, the packet loss rate remained stable at 0.053%, ensuring the smooth operation of the system.These research results indicate that VR product interaction systems based on 3D scene perception can effectively achieve interaction with 3D scene products, thereby improving user satisfaction and immersion.