Towards Large-Scale Self-Supervised Learning for Spatial Audio: Generating First-Order Ambisonics from Monophonic Recordings

Self-supervised learning (SSL) has emerged as a powerful approach for learning spatial audio representations, but its progress is constrained by the scarcity of large-scale First-Order Ambisonics (FOA) datasets. To address this limitation, we propose a fast and scalable on-the-fly spatialization framework that generates diverse FOA spatial audio samples from monophonic recordings during SSL training. Our method continuously synthesizes new spatialized samples by combining multiple monophonic audio sources with randomized spatial trajectories and overlapping sound events, significantly expanding the training data without requiring explicit labels. The spatialization process leverages room impulse responses and parametric spatialization techniques to ensure physically plausible spatial cues. By dynamically generating training data at each learning step, our approach enables large-scale SSL pre-training without the need for extensive amounts of FOA datasets. We evaluate the effectiveness of the generated dataset by pre-training a transformer-based SSL model and fine-tuning it for Sound Event Localization and Detection. Experimental results demonstrate that models trained on our synthetic dataset achieve competitive performance on real-world FOA benchmarks, bridging the gap between synthetic and real spatial audio. This work provides a scalable solution for self-supervised spatial audio learning, paving the way for advancements in spatial scene understanding, immersive media, and spatial AI applications.

Authors

Institutions

Publication Details

Journal
NOISE-CON proceedings
Published
2025-10-22
DOI
https://doi.org/10.3397/in_2025_1074769
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Large-Scale Self-Supervised Learning for Spatial Audio: Generating First-Order Ambisonics from Monophonic Recordings

Karen Rosero, Bruno Masiero, Orlem Lima dos Santos, Roberto Lotufo
NOISE-CON proceedings
Music and Audio Processing
article

Towards Large-Scale Self-Supervised Learning for Spatial Audio: Generating First-Order Ambisonics from Monophonic Recordings

Karen Rosero, Bruno Masiero, Orlem Lima dos Santos, Roberto Lotufo
article en

Abstract

Self-supervised learning (SSL) has emerged as a powerful approach for learning spatial audio representations, but its progress is constrained by the scarcity of large-scale First-Order Ambisonics (FOA) datasets. To address this limitation, we propose a fast and scalable on-the-fly spatialization framework that generates diverse FOA spatial audio samples from monophonic recordings during SSL training. Our method continuously synthesizes new spatialized samples by combining multiple monophonic audio sources with randomized spatial trajectories and overlapping sound events, significantly expanding the training data without requiring explicit labels. The spatialization process leverages room impulse responses and parametric spatialization techniques to ensure physically plausible spatial cues. By dynamically generating training data at each learning step, our approach enables large-scale SSL pre-training without the need for extensive amounts of FOA datasets. We evaluate the effectiveness of the generated dataset by pre-training a transformer-based SSL model and fine-tuning it for Sound Event Localization and Detection. Experimental results demonstrate that models trained on our synthetic dataset achieve competitive performance on real-world FOA benchmarks, bridging the gap between synthetic and real spatial audio. This work provides a scalable solution for self-supervised spatial audio learning, paving the way for advancements in spatial scene understanding, immersive media, and spatial AI applications.

NOISE-CON proceedingsVol. 272(3)
Universidade Estadual de Campinas (UNICAMP) (BR), Carnegie Mellon University (US)
Openalex Percentile: Top 61%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Towards Large-Scale Self-Supervised Learning for Spatial Audio: Generating First-Order Ambisonics from Monophonic Recordings — Karen Rosero, Bruno Masiero, et al. · NOISE-CON proceedings (2025) | TGRS Research Map | TGRS