OSIRITap: Whole-Body Interface that Recognizes Tap Input Using Only an HMD and Wrist-Mounted IMUs

Virtual and mixed reality (VR/MR) technologies have recently enhanced gesture recognition and motion tracking. While on-body interaction has been widely explored for system input, it suffers from input area limitations and the need for customized or expensive devices. Our proposal, OSIRITap, utilizes only an HMD and wrist-worn IMUs to realize full-body tap input. It performs whole body and hand tracking by the HMD when the hands are within the field of view (FoV) and by combining HMD and IMU when the hands are outside the FoV. Experiments confirm that the technique can recognize taps on various body parts. Additionally, we implement two applications to showcase the effectiveness of our approach.