A source separation approach for the joint representation of OBA and SBA under reverberation conditions

Spatial audio is implemented in three formats, i.e., Channel-Based Audio (CBA), Object-Based Audio (OBA), and Scene-Based audio (SBA). The joint representation of multiple audio formats can combine their advantages to satisfy the technical requirements of complex audio scenes. Specifically, the joint representation of object-based audio and scene-based audio plays a crucial role in spatial audio. However, the recorded SBA signal contains the associated components of OBA, which results in mutual interference during sound field reconstruction. Therefore, separating the target SBA component from the original SBA signal becomes the key to achieving the combination of the two audio formats.In fact, our previous work deals with outdoor applications, and a source separation approach for the recorded SBA signals in the joint representation of OBA and SBA under non-reverberation conditions was proposed. In this paper, a linear convolution model for the original SBA signal under reverberation conditions is firstly built up for the indoor applications. Then an NMF-based sound source separation algorithm is proposed, while a novel EM parameter initialization method is also proposed for the algorithm. Finally, the effectiveness of the proposed separation algorithm is verified by groups of experiments.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icsidp62679.2024.10868345
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A source separation approach for the joint representation of OBA and SBA under reverberation conditions

Zhiyu Li, Shenghui Zhao, Jing Wang, Jiawei Peng et al.
Speech and Audio Processing
article

A source separation approach for the joint representation of OBA and SBA under reverberation conditions

Zhiyu Li, Shenghui Zhao, Jing Wang, Jiawei Peng, Xiao Cao
article en

Abstract

Spatial audio is implemented in three formats, i.e., Channel-Based Audio (CBA), Object-Based Audio (OBA), and Scene-Based audio (SBA). The joint representation of multiple audio formats can combine their advantages to satisfy the technical requirements of complex audio scenes. Specifically, the joint representation of object-based audio and scene-based audio plays a crucial role in spatial audio. However, the recorded SBA signal contains the associated components of OBA, which results in mutual interference during sound field reconstruction. Therefore, separating the target SBA component from the original SBA signal becomes the key to achieving the combination of the two audio formats.In fact, our previous work deals with outdoor applications, and a source separation approach for the recorded SBA signals in the joint representation of OBA and SBA under non-reverberation conditions was proposed. In this paper, a linear convolution model for the original SBA signal under reverberation conditions is firstly built up for the indoor applications. Then an NMF-based sound source separation algorithm is proposed, while a novel EM parameter initialization method is also proposed for the algorithm. Finally, the effectiveness of the proposed separation algorithm is verified by groups of experiments.

Beijing Institute of Technology (CN)
Nature
Reduced inequalities
Openalex Percentile: Top 70%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A source separation approach for the joint representation of OBA and SBA under reverberation conditions — Zhiyu Li, Shenghui Zhao, et al. · (2024) | TGRS Research Map | TGRS