Detection of Early Parkinson's Disease by Leveraging Speech Foundation Models

Parkinson's disease (PD) is a progressive neurodegenerative disorder affecting millions worldwide, characterized by a wide range of motor and non-motor symptoms. Among these symptoms, alterations in speech and voice quality stand out as early and prominent indicators of the disease. Recently, the emergence of speech foundation models has revolutionized the field by providing powerful tools for speech processing and feature extraction. In this article, we investigate the capabilities of three state-of the art speech foundation models, wav2vec2.0, Whisper and SeamlessM4T, to develop robust and accurate methods for PD detection from voice recordings. We experiment with both direct feature extraction and finetuning of the foundation models for the PD classification task, and validate the results against clinical and neuroimaging data. We achieve promising results using both pretrained features and models' finetuning, with finetuning providing stronger performance, up to 91.35% for AUC, which is the new state of the art on the ICEBERG dataset. The predictions of our models also show good correlation with clinical as well as DaTSCAN scores, proving the feasibility to apply speech foundation models for detection of early PD.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Biomedical and Health Informatics
Published
2025-03-07
DOI
https://doi.org/10.1109/jbhi.2025.3548917
Citations
7
Primary Topic
Voice and Speech Disorders
Type
article
Field-Weighted Citation Impact
8.15
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Detection of Early Parkinson's Disease by Leveraging Speech Foundation Models

Jean‐Christophe Corvol, Mounîm A. El‐Yacoubi, Quang Dao, Isabelle Arnulf et al.
7 citations
IEEE Journal of Biomedical and Health Informatics
Voice and Speech Disorders
8.15
article

Detection of Early Parkinson's Disease by Leveraging Speech Foundation Models

Jean‐Christophe Corvol, Mounîm A. El‐Yacoubi, Quang Dao, Isabelle Arnulf, Laetitia Jeancolas, Dijana Petrovska Delacrétaz, Alizé Chalançon, Sara Sambin, Stéphane Lehéricy, Graziella Mangone, Manon Gomes, Marie Vidailhet
article en
7 citations

Abstract

Parkinson's disease (PD) is a progressive neurodegenerative disorder affecting millions worldwide, characterized by a wide range of motor and non-motor symptoms. Among these symptoms, alterations in speech and voice quality stand out as early and prominent indicators of the disease. Recently, the emergence of speech foundation models has revolutionized the field by providing powerful tools for speech processing and feature extraction. In this article, we investigate the capabilities of three state-of the art speech foundation models, wav2vec2.0, Whisper and SeamlessM4T, to develop robust and accurate methods for PD detection from voice recordings. We experiment with both direct feature extraction and finetuning of the foundation models for the PD classification task, and validate the results against clinical and neuroimaging data. We achieve promising results using both pretrained features and models' finetuning, with finetuning providing stronger performance, up to 91.35% for AUC, which is the new state of the art on the ICEBERG dataset. The predictions of our models also show good correlation with clinical as well as DaTSCAN scores, proving the feasibility to apply speech foundation models for detection of early PD.

IEEE Journal of Biomedical and Health InformaticsVol. 29(7)
Centre National de la Recherche Scientifique (FR), Inserm (FR), Sorbonne Université (FR), Assistance Publique – Hôpitaux de Paris (FR), Institut du Cerveau (FR), Concordia University (CA)
Openalex Percentile: Top 2%
Voice and Speech Disorders
8.15
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.