A source separation approach for the joint representation of OBA and SBA under reverberation conditions
Spatial audio is implemented in three formats, i.e., Channel-Based Audio (CBA), Object-Based Audio (OBA), and Scene-Based audio (SBA). The joint representation of multiple audio formats can combine their advantages to satisfy the technical requirements of complex audio scenes. Specifically, the joint representation of object-based audio and scene-based audio plays a crucial role in spatial audio. However, the recorded SBA signal contains the associated components of OBA, which results in mutual interference during sound field reconstruction. Therefore, separating the target SBA component from the original SBA signal becomes the key to achieving the combination of the two audio formats.In fact, our previous work deals with outdoor applications, and a source separation approach for the recorded SBA signals in the joint representation of OBA and SBA under non-reverberation conditions was proposed. In this paper, a linear convolution model for the original SBA signal under reverberation conditions is firstly built up for the indoor applications. Then an NMF-based sound source separation algorithm is proposed, while a novel EM parameter initialization method is also proposed for the algorithm. Finally, the effectiveness of the proposed separation algorithm is verified by groups of experiments.
Authors
- Zhiyu Li (ORCID: https://orcid.org/0009-0007-0566-8279)
- Shenghui Zhao (ORCID: https://orcid.org/0000-0002-0844-2319)
- Jing Wang (ORCID: https://orcid.org/0000-0002-3653-9951)
- Jiawei Peng (ORCID: https://orcid.org/0000-0002-1608-3280)
- Xiao Cao
Institutions
- Beijing Institute of Technology (CN)
Publication Details
- Published
- 2024-11-22
- DOI
- https://doi.org/10.1109/icsidp62679.2024.10868345
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Nature