Move'n'Hold Pro: Consistent Spatial Interaction Techniques for Object Manipulation with Handheld and Head-mounted Displays in Extended Reality

Extended Reality (XR) technologies are still lacking appropriate interaction methods that enable users to seamlessly switch between different XR devices and degrees of virtuality. Addressing this gap, we present Move’n’Hold Pro – a set of consistent object manipulation techniques that are available for Mixed Reality handheld displays (MR-HHDs) as well as for Mixed and Virtual Reality head-mounted displays (MR-/VR-HMDs). Move’n’Hold Pro extends MR- and VR-HMDs with a tablet controller that implements object manipulation methods proposed by latest research on MR-HHD-UIs. Thereby, users can combine tablet movement and peripheral touch to translate or rotate virtual objects through direct or continuous manipulations. In our evaluation, comparing Move’n’Hold Pro to a State of the Art system, Move’n’Hold Pro was rated as the preferred system and to be easier to relearn. Furthermore, Move’n’Hold Pro reduced cognitive efforts, improved usability, and provided more cross-device benefits.