Toward Immersive Metaverse Experience: A Wireless Adaptive 3-D Human Modeling System

The concept of the metaverse envisions an immersive environment where people can interact, participate in 3D meetings, engage in immersive gaming, and work, and experience the seamless integration of real and virtual worlds. Mixed reality (MR) systems hold significant potential to realize this vision. However, current MR environments face key technical challenges, such as limited network bandwidth and computing capacity. This paper addresses these issues by proposing A wireless adaptive 3D human modeling system calledWadmanMR. WadmanMR dynamically adapts to varying computational and network conditions through a sophisticated integration of smart cameras, servers, and MR headsets, enabling real-time 3D human modeling from 2D images and videos. Performance evaluations of WadmanMR demonstrate that it can maintain real-time processing standards, achieving an average end-to-end latency of less than 100ms and packet loss below 1%, under varying network conditions. WadmanMR outperforms the current state-of-the-art like MagicStream, ExPose and Pixie. Furthermore, this paper explores several open research issues aimed at further improving the performance and applicability of MR systems.