Meta-Learning For Variable Array Configurations in End-to-End Few-Shot Multichannel Speech Enhancement

Nowadays deep neural networks are a common choice for multichannel speech processing as they may outperform the traditional concatenation of a linear beamformer and a post-filter in challenging scenarios. To obtain strong spatial selectivity, these approaches are typically trained for a specific microphone array configuration. However, it was recently shown that such models are sensitive even to small perturbations in the microphones placements. In this paper we propose a method for handling variable array configurations based on model-agnostic meta-learning. We demonstrate that the proposed approach increases robustness to changes in the array configurations, i.e., mismatched conditions, while maintaining the same performance as the array-specific model on matched conditions.

Authors

Institutions

Publication Details

Published
2024-09-09
DOI
https://doi.org/10.1109/iwaenc61483.2024.10693988
Citations
2
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.70

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Meta-Learning For Variable Array Configurations in End-to-End Few-Shot Multichannel Speech Enhancement

Jean-Marie Lemercier, Kristina Tesch, Timo Gerkmann, Alina Mannanova
2 citations
Speech and Audio Processing
0.70
article

Meta-Learning For Variable Array Configurations in End-to-End Few-Shot Multichannel Speech Enhancement

Jean-Marie Lemercier, Kristina Tesch, Timo Gerkmann, Alina Mannanova
article en
2 citations

Abstract

Nowadays deep neural networks are a common choice for multichannel speech processing as they may outperform the traditional concatenation of a linear beamformer and a post-filter in challenging scenarios. To obtain strong spatial selectivity, these approaches are typically trained for a specific microphone array configuration. However, it was recently shown that such models are sensitive even to small perturbations in the microphones placements. In this paper we propose a method for handling variable array configurations based on model-agnostic meta-learning. We demonstrate that the proposed approach increases robustness to changes in the array configurations, i.e., mismatched conditions, while maintaining the same performance as the array-specific model on matched conditions.

Universität Hamburg (DE)
Deutsche Forschungsgemeinschaft
Openalex Percentile: Top 31%
Speech and Audio Processing
0.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.