BSM-iMagLS: ILD Informed Binaural Signal Matching for Reproduction With Head-Mounted Microphone Arrays
Headphone listening in applications such as augmented and virtual reality (AR and VR) relies on high-quality spatial audio to ensure immersion, making accurate binaural reproduction a critical component. As capture devices, wearable arrays with only a few microphones with irregular arrangement face challenges in achieving a reproduction quality comparable to that of arrays with a large number of microphones. Binaural signal matching (BSM) has recently been presented as a signal-independent approach for generating high-quality binaural signal using only a few microphones, which is further improved using magnitude-least squares (MagLS) optimization at high frequencies. This paper extends BSM with MagLS by introducing interaural level difference (ILD) into the MagLS, integrated into BSM (BSM-iMagLS). Using a deep neural network (DNN)-based solver, BSM-iMagLS achieves joint optimization of magnitude, ILD, and magnitude derivatives, improving spatial fidelity. Performance is validated through theoretical analysis, numerical simulations with diverse HRTFs and head-mounted array geometries, and listening experiments, demonstrating a substantial reduction in ILD errors while maintaining comparable magnitude accuracy to state-of-the-art solutions. The results highlight the potential of BSM-iMagLS to enhance binaural reproduction for wearable and portable devices.
Authors
- Boaz Rafaely (ORCID: https://orcid.org/0000-0002-6819-9250)
- Zamir Ben-Hur (ORCID: https://orcid.org/0000-0002-7476-771X)
- Or Berebi (ORCID: https://orcid.org/0000-0002-2562-8190)
- David Lou Alon
Institutions
- Ben-Gurion University of the Negev (IL)
- META Health (US)
Publication Details
- Journal
- IEEE Transactions on Audio Speech and Language Processing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/taslpro.2025.3581096
- Citations
- 2
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 2.97