Generalizability of Predictive and Generative Speech Enhancement Models to Pathological Speakers
State-of-the-art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for both predictive and generative SE models, including (i) training models from scratch using pathological data, (ii) fine-tuning models pre-trained on neurotypical speech with additional data from pathological speakers, and (iii) speaker-specific personalization using only data from the individual pathological test speaker. Our results show that, despite the limited size of pathological speech datasets, SE models can be successfully trained or fine-tuned on such data. Fine-tuning models with data from several pathological speakers yields the largest performance improvements, while speaker-specific personalization is less effective, likely due to the small amount of data available per speaker. These findings highlight the challenges and potential strategies for improving SE performance for pathological speakers.
Authors
- Mingzhen Hou
- Ina Kodrasi (ORCID: https://orcid.org/0000-0002-1747-1322)
- Ante Jukić (ORCID: https://orcid.org/0000-0003-2202-2203)
Institutions
- Nvidia (United States) (US)
- Idiap Research Institute (CH)
Publication Details
- Published
- 2026-04-21
- DOI
- https://doi.org/10.1109/icassp55912.2026.11461028
- Primary Topic
- Voice and Speech Disorders
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation