PLATONE: An Immersive Geospatial Audio Spatialization Platform
In the rapidly evolving landscape of mixed reality (MR) and spatial computing, the convergence of physical and virtual spaces is becoming increasingly crucial for enabling immersive, large-scale user experiences and shaping inter-reality dynamics. This is particularly significant for immersive audio at city-scale, where the 3D geometry of the environment must be considered, as it drastically influences how sound is perceived by the listener. This paper introduces PLATONE, a novel proof-of-concept MR platform designed to augment urban contexts with environment-dependent spatialized audio. It leverages custom hardware for localization and orientation, alongside a cloud-based pipeline for generating real-time binaural audio. By utilizing open-source 3D building datasets, sound propagation effects such as occlusion, reverberation, and diffraction are accurately simulated. This work establishes a compelling foundation for further research and development, aiming to redefine the integration of spatial audio in MR applications.
Authors
- Yusuke Obuchi
- Yijun Qian (ORCID: https://orcid.org/0009-0005-7669-156X)
- Alex Orsholits (ORCID: https://orcid.org/0000-0001-8517-8753)
- Manabu Tsukada (ORCID: https://orcid.org/0000-0001-8045-3939)
- E. Nardini
Institutions
- Nikken Sekkei (Japan) (JP)
- The University of Tokyo (JP)
Publication Details
- Published
- 2024-08-12
- DOI
- https://doi.org/10.1109/metacom62920.2024.00020
- Citations
- 2
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.70