Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditions
This work is concerned with devising a robust Parkinson’s (PD) disease detector from speech in real-world operating conditions using (i) foundational models, and (ii) speech enhancement (SE) methods. To this end, we first fine-tune several foundational-based models on the standard PC-GITA (s-PCGITA) clean data. Our results demonstrate superior performance to previously proposed models. Second, we assess the generalization capability of the PD models on the extended PCGITA (e-PC-GITA) recordings, collected in real-world operative conditions, and observe a severe drop in performance moving from ideal to real-world conditions. Third, we align training and testing conditions applaying off-the-shelf SE techniques on e-PC-GITA, and a significant boost in performance is observed only for the foundational-based models. Finally, combining the two best foundational-based models trained on s-PCGITA, namely WavLM Base and Hubert Base, yielded top performance on the enhanced e-PC-GITA
Authors
- Juan Rafael Orozco‐Arroyave (ORCID: https://orcid.org/0000-0002-8507-0782)
- Giampiero Salvi (ORCID: https://orcid.org/0000-0002-3323-5311)
- Torbjørn Svendsen (ORCID: https://orcid.org/0000-0003-0578-7941)
- Moreno La Quatra (ORCID: https://orcid.org/0000-0001-8838-064X)
- Sabato Marco Siniscalchi (ORCID: https://orcid.org/0000-0002-0770-0507)
- Maria Francesca Turco
Publication Details
- Published
- 2024-09-01
- DOI
- https://doi.org/10.21437/interspeech.2024-522
- Citations
- 21
- Primary Topic
- Voice and Speech Disorders
- Type
- article
- Field-Weighted Citation Impact
- 6.86