Explainable DNN-Based Beamformer With Postfilter

This paper introduces an explainable DNN-based beamformer with a postfilter (ExNet-BF+PF) for multichannel signal processing. Our approach combines the U-Net network with a beamformer structure to address this problem. The method involves a two-stage processing pipeline. In the first stage, time-invariant weights are applied to construct a multichannel spatial filter, namely a beamformer. In the second stage, a timevarying single-channel post-filter is applied at the beamformer output. Additionally, we incorporate an attention mechanism inspired by its successful application in noisy and reverberant environments to improve speech enhancement further. The proposed scheme obviates the necessity for prior knowledge of the speaker's activity, which is required in classical beamforming designs. Furthermore, our study fills a gap in the existing literature by conducting a thorough spatial analysis of the network's performance. Specifically, we examine how the network utilizes spatial information during processing. This analysis yields valuable insights into the network's functionality, thereby enhancing our understanding of its overall performance. A thorough experimental study analyzes the performance of the proposed method in various scenarios and compares both the results and computational resource consumption with several baseline methods, including the classical Minimum Variance Distortionless Response (MVDR) beamformer, Deep Neural Network (DNN)-based spatial filters that preserve a beamforming structure, and deep end-to-end schemes. Audio samples are available on our project page.1 The code is available on our GitHub repository

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Audio Speech and Language Processing
Published
2025-01-01
DOI
https://doi.org/10.1109/taslpro.2025.3581110
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explainable DNN-Based Beamformer With Postfilter

Sharon Gannot, Jung‐Suk Lee, Daniel D.E. Wong, Aileen Cleary Cohen
IEEE Transactions on Audio Speech and Language Processing
Speech Recognition and Synthesis
article

Explainable DNN-Based Beamformer With Postfilter

Sharon Gannot, Jung‐Suk Lee, Daniel D.E. Wong, Aileen Cleary Cohen
article en

Abstract

This paper introduces an explainable DNN-based beamformer with a postfilter (ExNet-BF+PF) for multichannel signal processing. Our approach combines the U-Net network with a beamformer structure to address this problem. The method involves a two-stage processing pipeline. In the first stage, time-invariant weights are applied to construct a multichannel spatial filter, namely a beamformer. In the second stage, a timevarying single-channel post-filter is applied at the beamformer output. Additionally, we incorporate an attention mechanism inspired by its successful application in noisy and reverberant environments to improve speech enhancement further. The proposed scheme obviates the necessity for prior knowledge of the speaker's activity, which is required in classical beamforming designs. Furthermore, our study fills a gap in the existing literature by conducting a thorough spatial analysis of the network's performance. Specifically, we examine how the network utilizes spatial information during processing. This analysis yields valuable insights into the network's functionality, thereby enhancing our understanding of its overall performance. A thorough experimental study analyzes the performance of the proposed method in various scenarios and compares both the results and computational resource consumption with several baseline methods, including the classical Minimum Variance Distortionless Response (MVDR) beamformer, Deep Neural Network (DNN)-based spatial filters that preserve a beamforming structure, and deep end-to-end schemes. Audio samples are available on our project page.1 The code is available on our GitHub repository

IEEE Transactions on Audio Speech and Language ProcessingVol. 33
Bar-Ilan University (IL), META Health (US)
Affordable and clean energy
Openalex Percentile: Top 93%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.