Microphone Array Signal Processing and Deep Learning for Speech Enhancement: Combining model-based and data-driven approaches to parameter estimation and filtering
Multichannel acoustic signal processing is a well-established and powerful tool to exploit the spatial diversity between a target signal and nontarget or noise sources for signal enhancement. However, the textbook solutions for optimal data-dependent spatial filtering rest on the knowledge of second-order statistical moments of the signals, which have traditionally been difficult to acquire. In this contribution, we compare model-based, purely data-driven, and hybrid approaches to parameter estimation and filtering, where the latter tries to combine the benefits of model-based signal processing and data-driven deep learning to overcome their individual deficiencies. We illustrate the underlying design principles with examples from noise reduction, source separation, and dereverberation.
Authors
- Tomohiro Nakatani (ORCID: https://orcid.org/0000-0002-7487-7150)
- Marc Delcroix (ORCID: https://orcid.org/0000-0002-5175-7834)
- Christoph Boeddeker (ORCID: https://orcid.org/0000-0002-8701-1567)
- Tsubasa Ochiai (ORCID: https://orcid.org/0000-0002-2519-2032)
- Reinhold Haeb‐Umbach (ORCID: https://orcid.org/0000-0001-9468-7330)
Institutions
- Paderborn University (DE)
- NTT (Japan) (JP)
Publication Details
- Journal
- IEEE Signal Processing Magazine
- Published
- 2024-11-01
- DOI
- https://doi.org/10.1109/msp.2024.3451653
- Citations
- 5
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 1.75