Development of a 360-Degree Medical Live Streaming System with Learner-Controllable Picture-in-Picture Functionality

Cross-reality (XR) technology using head-mounted displays (HMDs) is still under development in the education field, and there is a lack of platforms that provide learning programs tailored to the needs of educators. In this study, we developed an XR system that improves usability for learners in medical live demonstrations. / The developed system transmits 360-degree camera and medical image, and allows users to move and zoom in and out of the picture-in-picture (PinP) medical image using HMD controllers, optimizing the layout for each learner. An implementation demonstration was conducted using an endoscope, achieving performance at a resolution of 1920 x 960 and a frame rate of 29-30 fps. The system developed in this study offers high interactivity, enabling learners to customize their viewing experience. / This system can be applied to live demonstrations in various medical fields, providing immersive and personalized learning experiences. However, to implement actual demonstrations, security and other functional modifications are needed. Further research will focus on user evaluations and improving system functionalities to ensure effective and secure usage in real-world applications.