Attend to Listen: A Single-Input/Binaural-Output Heterophasic MVDR Filter for Noise Reduction and Perceptual Rendering
In this paper, we present a novel single-input/ binaural-output (SIBO) minimum variance distortionless response (MVDR) noise reduction method, which involves formulating two MVDR sub-filters, one for the left ear and the other for the right ear, by minimizing the interaural coherence of the noise signal while ensuring the distortionless constraint, so that the desired speech signal can pass through the filter without distortion. Subsequently, a unique heterophasic binaural presentation is generated. The method effectively reduces noise while directing the desired signal and residual noise to different directions/zones in the perceptual space. This utilization of human binaural perception properties enhances speech intelligibility. A deep neural network (DNN) based noise covariance matrix estimation method facilitates the implementation of the binaural heterophasic filters in simulations and listening tests. The results demonstrate the superiority of the proposed SIBO MVDR method in enhancing both speech quality and intelligibility as compared to the conventional single-input/single-output (SISO) MVDR filter.
Authors
- Xianrui Wang (ORCID: https://orcid.org/0000-0002-8715-4111)
- Ningning Pan (ORCID: https://orcid.org/0000-0001-5955-7100)
- Jilu Jin (ORCID: https://orcid.org/0000-0003-2967-8379)
- Jacob Benesty
- Jingdong Chen (ORCID: https://orcid.org/0000-0003-0083-9247)
Institutions
- Université du Québec à Montréal (CA)
- Northwestern Polytechnical University (CN)
- Southwestern University of Finance and Economics (CN)
- Institut National de la Recherche Scientifique (CA)
Publication Details
- Journal
- IEEE Transactions on Audio Speech and Language Processing
- Published
- 2024-12-18
- DOI
- https://doi.org/10.1109/taslp.2024.3519895
- Citations
- 2
- Primary Topic
- Image and Signal Denoising Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.50
Funders
- National Natural Science Foundation of China