Investigation of Server–Based Spatial Audio for Metaverse Concert Distribution

Modern music delivery contexts include the real-time distribution of musical performances as immersive media (‘metaverse concerts’) to online audiences. This paper details an investigatory deployment of a novel server-based spatial audio rendering system for this context, considering distribution to practical wireless Virtual Reality (VR) audience endpoint. Ambisonic auralisation is provided with 6 Degrees of Freedom (6DoF) using a Spatial Impulse Response (SIR) interpolation approach which is efficient for large-scale distribution. Binaural audio is distributed to a mobile device at the audience endpoint using low-latency Network Music Performance (NMP) streaming software. Improvement in spatial audio rendering is achieved relative to that which is possible on consumer HMDs. Latency measurements suggest acceptable motion-sound latency is not achieved for the mobile device, however may be achievable in other distribution contexts, or with optimised systems.