DualStage: Enhancing Emotional Connections through Music Visualization for Synchronizing Live and Virtual Performances

The pandemic has accelerated the adoption of virtual concerts, bridging the physical and virtual worlds for performers and audiences. However, the emotional connection of live concerts remains irreplaceable. To address this issue, we propose DualStage, a real-time emotional visualization system for synchronizing live and virtual performances. The system will visualize the collected data, encompassing various aspects such as the performers' movements, the audience's interactions, and the tempo, rhythm, and intensity of the music. By integrating these elements, the system aims to create a comprehensive and immersive visual experience that enhances the emotional connection between performers and both onsite and online audiences. We conducted an exploratory study with 22 participants to refine the system and enhance cross-reality engagement. The results showed that most participants recognized the feasibility and effectiveness of the system.