A SuperCollider-Based Spatial Audio Performance System with AR Interfaces

The presented real-time interactive spatial audio performance system connects an Augmented Reality (AR) interface with performers. Virtual objects manipulated by performers' gestures are tracked with six degrees of freedom (6DOF) in real time, and the resulting data are transmitted to the audio engine via Open Sound Control (OSC). The system processes live audio input from musical instruments to support dynamic sound manipulation and spatial transformations. Higher-Order Ambisonics (HOA) is employed for immersive spatial audio rendering, which allows performers' gestures to directly control sound positioning, spectral characteristics, and dynamic modulation during live performances.