Exploring the Physical and Virtual Audiences in Multiverse for Seamless XR Performance

VR concerts gained popularity during the COVID-19 pandemic, providing a novel experience that allowed audiences to transcend physical limitations and remotely enjoy live performances.In the post-pandemic, while live concerts gradually moved back onsite form, those virtual concert features were still appreciated.We introduce an XR performance system that integrates onsite audiences and online performers to create a seamless XR performance experience across spatial boundaries.The system uses sensors to digitize venue signals and real-time data from online performers' instruments, integrating both into a virtual world.The combined data is then displayed as visuals on onsite screens.In this work, we present several interactive features for audience engagement, creating a shared experience that bridges both the physical and virtual worlds.We focus on these interaction designs and evaluate them to explore the system's potential.It aims to propose design considerations and future directions for this interactive and innovative experience.