Speech Enhancement with MAP-based Training for Robust ASR

To improve noise robustness in automatic speech recognition (ASR), a common strategy is to employ speech enhancement (SE) models as front-ends for ASR systems. However, SE models often introduce artifacts into enhanced signals, which can degrade ASR performance, particularly when the SE and ASR models are trained separately. Although various methods have been proposed to address this issue, they often come at the expense of increasing implementation complexity. Hence, this study proposes a maximum a posteriori (MAP) algorithm for training SE models by incorporating the posterior probability of clean speech, given the enhanced speech, into the loss function. Experimental results show that our method enhances the compatibility between SE and ASR models in both in-domain and out-of-domain testing scenarios, notably improving ASR performance. The proposed method does not require prior knowledge of ASR models or speech content during training or inference, nor does it involve additional post-processing steps.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10887859
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Speech Enhancement with MAP-based Training for Robust ASR

You-Jin Li, Borching Su, Rong Chao, Yu Tsao
Speech and Audio Processing
article

Speech Enhancement with MAP-based Training for Robust ASR

You-Jin Li, Borching Su, Rong Chao, Yu Tsao
article en

Abstract

To improve noise robustness in automatic speech recognition (ASR), a common strategy is to employ speech enhancement (SE) models as front-ends for ASR systems. However, SE models often introduce artifacts into enhanced signals, which can degrade ASR performance, particularly when the SE and ASR models are trained separately. Although various methods have been proposed to address this issue, they often come at the expense of increasing implementation complexity. Hence, this study proposes a maximum a posteriori (MAP) algorithm for training SE models by incorporating the posterior probability of clean speech, given the enhanced speech, into the loss function. Experimental results show that our method enhances the compatibility between SE and ASR models in both in-domain and out-of-domain testing scenarios, notably improving ASR performance. The proposed method does not require prior knowledge of ASR models or speech content during training or inference, nor does it involve additional post-processing steps.

National Taiwan University (TW), Academia Sinica (TW)
Openalex Percentile: Top 96%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Speech Enhancement with MAP-based Training for Robust ASR — You-Jin Li, Borching Su, et al. · (2025) | TGRS Research Map | TGRS