Generalizability of Predictive and Generative Speech Enhancement Models to Pathological Speakers

State-of-the-art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for both predictive and generative SE models, including (i) training models from scratch using pathological data, (ii) fine-tuning models pre-trained on neurotypical speech with additional data from pathological speakers, and (iii) speaker-specific personalization using only data from the individual pathological test speaker. Our results show that, despite the limited size of pathological speech datasets, SE models can be successfully trained or fine-tuned on such data. Fine-tuning models with data from several pathological speakers yields the largest performance improvements, while speaker-specific personalization is less effective, likely due to the small amount of data available per speaker. These findings highlight the challenges and potential strategies for improving SE performance for pathological speakers.

Authors

Institutions

Publication Details

Published
2026-04-21
DOI
https://doi.org/10.1109/icassp55912.2026.11461028
Primary Topic
Voice and Speech Disorders
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generalizability of Predictive and Generative Speech Enhancement Models to Pathological Speakers

Mingzhen Hou, Ina Kodrasi, Ante Jukić
Voice and Speech Disorders
article

Generalizability of Predictive and Generative Speech Enhancement Models to Pathological Speakers

Mingzhen Hou, Ina Kodrasi, Ante Jukić
article en

Abstract

State-of-the-art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for both predictive and generative SE models, including (i) training models from scratch using pathological data, (ii) fine-tuning models pre-trained on neurotypical speech with additional data from pathological speakers, and (iii) speaker-specific personalization using only data from the individual pathological test speaker. Our results show that, despite the limited size of pathological speech datasets, SE models can be successfully trained or fine-tuned on such data. Fine-tuning models with data from several pathological speakers yields the largest performance improvements, while speaker-specific personalization is less effective, likely due to the small amount of data available per speaker. These findings highlight the challenges and potential strategies for improving SE performance for pathological speakers.

Nvidia (United States) (US), Idiap Research Institute (CH)
National Science Foundation
Openalex Percentile: Top 100%
Voice and Speech Disorders
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.