A Cross-Modal Contrastive Representation Learning Model for OSAHS Detection Based on Decoupling and Reconstruction Operations

Obstructive Sleep Apnea-Hypopnea Syndrome (OSAHS) significantly impacts public health and safety. Multimodal biomedical signals (MBS) are essential for OSAHS screening. However, current deep learning frameworks for MBS struggle to differentiate between modality-specific and shared information, leading to confusion and reduced model performance. Additionally, the heterogeneity of modalities and limited labeled data further hinder effective MBS modeling. To address these challenges, we propose a cross-modal contrastive learning method based on decoupling and reconstructing multimodal biomedical signals (CMDR). Specific encoders extract unique information from different modalities, while specific decoders handle modality reconstruction. A shared encoder then extracts patterns across modalities, using a cross-attention mechanism to decouple relationships and ensure orthogonality between modality-specific and shared features. Cross-modal contrastive learning is applied to the representations from each specific encoder, ensuring effective extraction and learning of modality-specific information. Finally, specific and shared features are fused, with a self-attention mechanism capturing both specificity and consistency of the signals. We validate CMDR on three multimodal biomedical signal datasets for OSAHS screening. Experimental results demonstrate that CMDR outperforms current baseline models, achieving an average F1-score improvement of 9.27%, setting a new state-of-the-art in OSAHS task performance.

Authors

Institutions

Publication Details

Published
2024-10-24
DOI
https://doi.org/10.1109/biocas61083.2024.10798333
Citations
1
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
0.33
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Cross-Modal Contrastive Representation Learning Model for OSAHS Detection Based on Decoupling and Reconstruction Operations

Hao Wu, Keith Siu-Fung Sze, Kaiqun Fang
1 citations
Fault Detection and Control Systems
0.33
article

A Cross-Modal Contrastive Representation Learning Model for OSAHS Detection Based on Decoupling and Reconstruction Operations

Hao Wu, Keith Siu-Fung Sze, Kaiqun Fang
article en
1 citations

Abstract

Obstructive Sleep Apnea-Hypopnea Syndrome (OSAHS) significantly impacts public health and safety. Multimodal biomedical signals (MBS) are essential for OSAHS screening. However, current deep learning frameworks for MBS struggle to differentiate between modality-specific and shared information, leading to confusion and reduced model performance. Additionally, the heterogeneity of modalities and limited labeled data further hinder effective MBS modeling. To address these challenges, we propose a cross-modal contrastive learning method based on decoupling and reconstructing multimodal biomedical signals (CMDR). Specific encoders extract unique information from different modalities, while specific decoders handle modality reconstruction. A shared encoder then extracts patterns across modalities, using a cross-attention mechanism to decouple relationships and ensure orthogonality between modality-specific and shared features. Cross-modal contrastive learning is applied to the representations from each specific encoder, ensuring effective extraction and learning of modality-specific information. Finally, specific and shared features are fused, with a self-attention mechanism capturing both specificity and consistency of the signals. We validate CMDR on three multimodal biomedical signal datasets for OSAHS screening. Experimental results demonstrate that CMDR outperforms current baseline models, achieving an average F1-score improvement of 9.27%, setting a new state-of-the-art in OSAHS task performance.

Shenzhen University (CN)
Openalex Percentile: Top 38%
Fault Detection and Control Systems
0.33
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Cross-Modal Contrastive Representation Learning Model for OSAHS Detection Based on Decoupling and Reconstruction Operations — Hao Wu, Keith Siu-Fung Sze, et al. · (2024) | TGRS Research Map | TGRS