User Interaction for WebGL-Based Desktop Metaverse

In this paper, we constructed a virtual gallery in the metaverse, using it as a platform to investigate various user interaction issues and explore methods to enhance the user experience in the desktop metaverse. We conducted two types of user studies: one focused on the relationship between virtual space and visual perception, including the relationship between viewpoint rotation and mouse movement, fixed view and free view, and teleportation; the other explored the relationship between virtual space and auditory experience, including individual mute control, distance-based sound volume, and speaker visibility. These studies led to design adjustments based on user feedback. We demonstrated that users prefer viewpoint rotation opposite to the mouse direction. For teleportation, users prefer a 3D icon that follows the mouse cursor, with a click functionality to teleport smoothly to the desired location. Besides, users prefer a fixed view in a third-person perspective in the desktop metaverse. The study's results for distance-based volume revealed a clear preference for adjusting the sound volume of others based on distance. We discovered preferences regarding the inner and outer radii of distance-based volume sound, with elaborated details in Section 4. The speaker visibility also improves the user experience and enhances the benefits of individual sound control. Thus, we suggest incorporating these features into future metaverse developments.