WaveWalker: Enabling Outdoor VR Experiences with Millimeter-wave RADAR

In this paper, we present WaveWalker, a follow-up version of DreamWalker, which enables users to be fully immersed in virtual reality (VR) while walking in the real world. Compared to Dreamwalker’s camera-based approach, our system uses millimeter-wave radar for tracking static and dynamic obstacles. WaveWalker offers benefits over its predecessor, DreamWalker, particularly in conditions involving low visibility and adverse weather such as dense fog. Our approach prioritizes user privacy by refraining from capturing or storing visual data on nearby individuals, while still effectively preventing the VR user from colliding with these dynamic obstacles. With lower power consumption, longer battery life, and the ability to function effectively in various lighting conditions, WaveWalker can offer greater operational flexibility in outdoor environments. The WaveWalker system comprises a smartphone, a single-board computer, and a VR headset mounted with a mmWave-radar. We use GPS and phone IMU data to continuously and precisely track the user’s real-world location.