Neural Directed Speech Enhancement with Dual Microphone Array in High Noise Scenario
In multi-speaker scenarios, leveraging spatial features is essential for enhancing target speech. While with limited microphone arrays, developing a compact multi-channel speech enhancement system remains challenging, especially in extremely low signal-to-noise ratio (SNR) conditions. To tackle this issue, we propose a triple-steering spatial selection method, a flexible framework that uses three steering vectors to guide enhancement and determine the enhancement range. Specifically, we introduce a causal-directed U-Net (CDUNet) model, which takes raw multi-channel speech and the desired enhancement width as inputs. This enables dynamic adjustment of steering vectors based on the target direction and fine-tuning of the enhancement region according to the angular separation between the target and interference signals. Our model with only a dual microphone array, excels in both speech quality and downstream task performance. It operates in real-time with minimal parameters, making it ideal for low-latency, on-device streaming applications.
Authors
- Qiang Zhou (ORCID: https://orcid.org/0009-0008-8662-7694)
- Zhen‐Hui Gong (ORCID: https://orcid.org/0000-0001-6112-7943)
- Kai Yu (ORCID: https://orcid.org/0000-0002-7102-9826)
- Haoyu Li (ORCID: https://orcid.org/0000-0002-7102-8348)
- Wen Wen (ORCID: https://orcid.org/0009-0003-1873-7262)
- Yu Xi
Institutions
- Shanghai Jiao Tong University (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10889345
- Citations
- 2
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 2.97
Funders
- Research and Development