Simultaneous Performance Across Two Locations: IoT-Based Motion Capture Integration in the Performing Arts

This study explores the implementation of simultaneous performance across two locations by integrating motion capture technology with the Internet of Things (IoT). Utilizing low-latency 5G communication and real-time data synchronization, the proposed system enables geographically distributed performers and audiences to participate synchronously in a shared theatrical experience. Core technologies include MediaPipe-based motion tracking, speech synthesis via a custom Text-to-Speech (TTS) engine, and a mapped buffering strategy designed to mitigate latency issues during cross-border performances. These components were applied in Hamlet Machineman, a collaborative production with the Department of Drama and Theatre at National Taiwan University, aiming to reimagine spatial and interactive possibilities in contemporary theatre through digital technologies. The results demonstrate the potential of IoT-driven performance frameworks to enhance real-time interaction, virtual-physical integration, and avatar-based control in contemporary performing arts. This research offers a model for future applications of simultaneous performance, bridging the gap between technological systems and live artistic expression.