PLATONE: An Immersive Geospatial Audio Spatialization Platform

In the rapidly evolving landscape of mixed reality (MR) and spatial computing, the convergence of physical and virtual spaces is becoming increasingly crucial for enabling immersive, large-scale user experiences and shaping inter-reality dynamics. This is particularly significant for immersive audio at city-scale, where the 3D geometry of the environment must be considered, as it drastically influences how sound is perceived by the listener. This paper introduces PLATONE, a novel proof-of-concept MR platform designed to augment urban contexts with environment-dependent spatialized audio. It leverages custom hardware for localization and orientation, alongside a cloud-based pipeline for generating real-time binaural audio. By utilizing open-source 3D building datasets, sound propagation effects such as occlusion, reverberation, and diffraction are accurately simulated. This work establishes a compelling foundation for further research and development, aiming to redefine the integration of spatial audio in MR applications.

Authors

Institutions

Publication Details

Published
2024-08-12
DOI
https://doi.org/10.1109/metacom62920.2024.00020
Citations
2
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.70
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PLATONE: An Immersive Geospatial Audio Spatialization Platform

Yusuke Obuchi, Yijun Qian, Alex Orsholits, Manabu Tsukada et al.
2 citations
Music and Audio Processing
0.70
article

PLATONE: An Immersive Geospatial Audio Spatialization Platform

Yusuke Obuchi, Yijun Qian, Alex Orsholits, Manabu Tsukada, E. Nardini
article en
2 citations

Abstract

In the rapidly evolving landscape of mixed reality (MR) and spatial computing, the convergence of physical and virtual spaces is becoming increasingly crucial for enabling immersive, large-scale user experiences and shaping inter-reality dynamics. This is particularly significant for immersive audio at city-scale, where the 3D geometry of the environment must be considered, as it drastically influences how sound is perceived by the listener. This paper introduces PLATONE, a novel proof-of-concept MR platform designed to augment urban contexts with environment-dependent spatialized audio. It leverages custom hardware for localization and orientation, alongside a cloud-based pipeline for generating real-time binaural audio. By utilizing open-source 3D building datasets, sound propagation effects such as occlusion, reverberation, and diffraction are accurately simulated. This work establishes a compelling foundation for further research and development, aiming to redefine the integration of spatial audio in MR applications.

Nikken Sekkei (Japan) (JP), The University of Tokyo (JP)
Openalex Percentile: Top 30%
Music and Audio Processing
0.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.