Pre-trained Feature Fusion and Matching for Mild Cognitive Impairment Detection
Effective diagnosis of Mild Cognitive Impairment (MCI), a preclinical stage of cognitive decline, is significant for delaying disease progression.While most current spontaneous speechbased diagnostic methods focus on English speech, the Interspeech 2024 TAUKADIAL Challenge proposed an innovative research direction to develop a language-agnostic approach to diagnose MCI.This paper proposes an MCI diagnosis method by analyzing and combining linguistic and acoustic features using the bilingual Chinese-English speech dataset provided by the challenge.We employed a pre-trained multilingual model and expressivity encoder to extract language-agnostic speech features.To overcome the challenges of data scarcity and language diversity, we implemented data augmentation and alignment to enhance the model's generalization.Our approach achieved 77.5% accuracy, demonstrating its effectiveness and potential on cross-lingual data.
Authors
- Hongdong Li (ORCID: https://orcid.org/0000-0003-4125-1554)
- Junwen Duan (ORCID: https://orcid.org/0000-0003-4955-9270)
- Fangyuan Wei
- Jin Liu (ORCID: https://orcid.org/0000-0001-6915-6183)
Publication Details
- Published
- 2024-09-01
- DOI
- https://doi.org/10.21437/interspeech.2024-2386
- Citations
- 6
- Primary Topic
- Health, Environment, Cognitive Aging
- Type
- article
- Field-Weighted Citation Impact
- 1.89
Funders
- National Science Foundation
- National Natural Science Foundation of China
- Central South University