Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer’s Disease Identification

Cognitive impairment detection through spontaneous speech is a promising avenue for early diagnosis of Alzheimer’s disease (AD) and mild cognitive impairment (MCI), where timely intervention can significantly improve patient outcomes. The PROCESS Grand Challenge at ICASSP 2025 addresses these tasks by promoting innovative classification and regression methods for detecting cognitive decline. In this paper, we propose a multimodal fusion strategy that combines interpretable linguistic features with temporal embeddings extracted from pretrained models. Our approach achieves an F1-score of 0.649 for the classification task (predicting healthy, MCI, dementia) and an RMSE of 2.628 for the regression task (MMSE score prediction), securing the top overall ranking in the competition.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10887657
Citations
3
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
7.44

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer’s Disease Identification

Long Guo, Yifan Gao, Hong Liu
3 citations
Speech and dialogue systems
7.44
article

Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer’s Disease Identification

Long Guo, Yifan Gao, Hong Liu
article en
3 citations

Abstract

Cognitive impairment detection through spontaneous speech is a promising avenue for early diagnosis of Alzheimer’s disease (AD) and mild cognitive impairment (MCI), where timely intervention can significantly improve patient outcomes. The PROCESS Grand Challenge at ICASSP 2025 addresses these tasks by promoting innovative classification and regression methods for detecting cognitive decline. In this paper, we propose a multimodal fusion strategy that combines interpretable linguistic features with temporal embeddings extracted from pretrained models. Our approach achieves an F1-score of 0.649 for the classification task (predicting healthy, MCI, dementia) and an RMSE of 2.628 for the regression task (MMSE score prediction), securing the top overall ranking in the competition.

Sichuan University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 4%
Speech and dialogue systems
7.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.