Contrastive Learning Neural Network with Multimodal Physiological Signal Fusion for Early Detection of Cognitive Impairment

With the rapid advancement of artificial intelligence in healthcare, early detection of cognitive impairment based on physiological signals has emerged as a significant research focus. Existing methods often struggle with challenges such as strong modality heterogeneity, data scarcity, and difficulty in feature alignment when processing multimodal inputs. To address these issues, this paper proposes a contrastive learning neural network framework (MCL-Net) that fuses multimodal physiological signals, including EEG, ECG, and EDA. The model employs modality-specific encoders to extract deep temporal representations and introduces a cross-modal contrastive mechanism to enhance semantic consistency and discriminative capacity. Trained in an end-to-end manner, MCL-Net jointly optimizes self-supervised contrastive loss and classification loss, thereby improving generalization under limited data conditions. Experimental evaluations conducted on a synthesized multimodal physiological dataset demonstrate that MCL-Net outperforms several baseline models in terms of accuracy, F1-score, and recall, while maintaining high stability even with reduced training data. Ablation studies further confirm the effectiveness of the contrastive module and modality fusion strategy. This work contributes a novel approach at the intersection of self-supervised learning, multimodal modeling, and physiological signal processing, providing both theoretical and practical support for the development of intelligent cognitive impairment screening systems and deep representation learning from multimodal physiological data.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/caibda65784.2025.11183258
Citations
1
Primary Topic
EEG and Brain-Computer Interfaces
Type
article
Field-Weighted Citation Impact
1.43
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Contrastive Learning Neural Network with Multimodal Physiological Signal Fusion for Early Detection of Cognitive Impairment

Lin Pang
1 citations
EEG and Brain-Computer Interfaces
1.43
article

Contrastive Learning Neural Network with Multimodal Physiological Signal Fusion for Early Detection of Cognitive Impairment

Lin Pang
article en
1 citations

Abstract

With the rapid advancement of artificial intelligence in healthcare, early detection of cognitive impairment based on physiological signals has emerged as a significant research focus. Existing methods often struggle with challenges such as strong modality heterogeneity, data scarcity, and difficulty in feature alignment when processing multimodal inputs. To address these issues, this paper proposes a contrastive learning neural network framework (MCL-Net) that fuses multimodal physiological signals, including EEG, ECG, and EDA. The model employs modality-specific encoders to extract deep temporal representations and introduces a cross-modal contrastive mechanism to enhance semantic consistency and discriminative capacity. Trained in an end-to-end manner, MCL-Net jointly optimizes self-supervised contrastive loss and classification loss, thereby improving generalization under limited data conditions. Experimental evaluations conducted on a synthesized multimodal physiological dataset demonstrate that MCL-Net outperforms several baseline models in terms of accuracy, F1-score, and recall, while maintaining high stability even with reduced training data. Ablation studies further confirm the effectiveness of the contrastive module and modality fusion strategy. This work contributes a novel approach at the intersection of self-supervised learning, multimodal modeling, and physiological signal processing, providing both theoretical and practical support for the development of intelligent cognitive impairment screening systems and deep representation learning from multimodal physiological data.

Guangdong University of Technology (CN), Guangdong University of Foreign Studies (CN)
Openalex Percentile: Top 15%
EEG and Brain-Computer Interfaces
1.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Contrastive Learning Neural Network with Multimodal Physiological Signal Fusion for Early Detection of Cognitive Impairment — Lin Pang · (2025) | TGRS Research Map | TGRS