Pre-trained Feature Fusion and Matching for Mild Cognitive Impairment Detection

Effective diagnosis of Mild Cognitive Impairment (MCI), a preclinical stage of cognitive decline, is significant for delaying disease progression.While most current spontaneous speechbased diagnostic methods focus on English speech, the Interspeech 2024 TAUKADIAL Challenge proposed an innovative research direction to develop a language-agnostic approach to diagnose MCI.This paper proposes an MCI diagnosis method by analyzing and combining linguistic and acoustic features using the bilingual Chinese-English speech dataset provided by the challenge.We employed a pre-trained multilingual model and expressivity encoder to extract language-agnostic speech features.To overcome the challenges of data scarcity and language diversity, we implemented data augmentation and alignment to enhance the model's generalization.Our approach achieved 77.5% accuracy, demonstrating its effectiveness and potential on cross-lingual data.

Authors

Publication Details

Published
2024-09-01
DOI
https://doi.org/10.21437/interspeech.2024-2386
Citations
6
Primary Topic
Health, Environment, Cognitive Aging
Type
article
Field-Weighted Citation Impact
1.89

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Pre-trained Feature Fusion and Matching for Mild Cognitive Impairment Detection

Hongdong Li, Junwen Duan, Fangyuan Wei, Jin Liu
6 citations
Health, Environment, Cognitive Aging
1.89
article

Pre-trained Feature Fusion and Matching for Mild Cognitive Impairment Detection

Hongdong Li, Junwen Duan, Fangyuan Wei, Jin Liu
article en
6 citations

Abstract

Effective diagnosis of Mild Cognitive Impairment (MCI), a preclinical stage of cognitive decline, is significant for delaying disease progression.While most current spontaneous speechbased diagnostic methods focus on English speech, the Interspeech 2024 TAUKADIAL Challenge proposed an innovative research direction to develop a language-agnostic approach to diagnose MCI.This paper proposes an MCI diagnosis method by analyzing and combining linguistic and acoustic features using the bilingual Chinese-English speech dataset provided by the challenge.We employed a pre-trained multilingual model and expressivity encoder to extract language-agnostic speech features.To overcome the challenges of data scarcity and language diversity, we implemented data augmentation and alignment to enhance the model's generalization.Our approach achieved 77.5% accuracy, demonstrating its effectiveness and potential on cross-lingual data.

National Science Foundation, National Natural Science Foundation of China, Central South University
Openalex Percentile: Top 15%
Health, Environment, Cognitive Aging
1.89
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.