Robust Sleep Stage Classification from Multimodal Physiological Signals Using a Cross-Modal Transformer with Missing Data Resilience

Accurate and robust classification of sleep stages, in particular classifying Wake, N1, N2, N3, and REM stages, is of uttermost importance to diagnose sleep disorders and promote overall health. Traditional laboratory-based polysomnography (PSG) is resource-intensive, while existing at-home monitoring solutions often struggle with noisy or missing data. This research proposes a deep learning framework featuring a Cross-Modal Transformer for sleep stage classification that fuses multimodal physiological data (EEG, EOG, EMG) while maintaining performance in the presence of incomplete sensor streams. Unlike simple attention or gated fusion which proved ineffective, the Transformer architecture forces the model to learn a joint, intertwined representation by treating the modalities as a single sequence of feature "tokens." The methodology involves extracting comprehensive features from the Sleep-EDF dataset, followed by subject-wise train-test splitting and aggressive data augmentation that simulates the random loss of any modality. A baseline attention model demonstrated a significant failure to adapt, with Cohen's Kappa score dropping from 0.74 to 0.64-0.66 when a modality was removed. In contrast, the Cross-Modal Transformer achieved a Kappa of 0.75 and accuracy of 81.3 with all modalities present and demonstrated graceful degradation, with scores of 0.74 when missing EMG, 0.73 when missing EOG, and a strong 0.72 when relying on EEG only. Future work will explore real-time implementation, investigate the framework's adaptability to other physiological signals, and evaluate its performance on more diverse and larger datasets from real-world, at-home monitoring scenarios.

Institutions

Publication Details

Journal
George Mason University
Published
2025-09-12
DOI
https://doi.org/10.13021/jssr2025.5177
Primary Topic
Archaeological Research and Protection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust Sleep Stage Classification from Multimodal Physiological Signals Using a Cross-Modal Transformer with Missing Data Resilience

George Mason University
Archaeological Research and Protection
article

Robust Sleep Stage Classification from Multimodal Physiological Signals Using a Cross-Modal Transformer with Missing Data Resilience

article en

Abstract

Accurate and robust classification of sleep stages, in particular classifying Wake, N1, N2, N3, and REM stages, is of uttermost importance to diagnose sleep disorders and promote overall health. Traditional laboratory-based polysomnography (PSG) is resource-intensive, while existing at-home monitoring solutions often struggle with noisy or missing data. This research proposes a deep learning framework featuring a Cross-Modal Transformer for sleep stage classification that fuses multimodal physiological data (EEG, EOG, EMG) while maintaining performance in the presence of incomplete sensor streams. Unlike simple attention or gated fusion which proved ineffective, the Transformer architecture forces the model to learn a joint, intertwined representation by treating the modalities as a single sequence of feature "tokens." The methodology involves extracting comprehensive features from the Sleep-EDF dataset, followed by subject-wise train-test splitting and aggressive data augmentation that simulates the random loss of any modality. A baseline attention model demonstrated a significant failure to adapt, with Cohen's Kappa score dropping from 0.74 to 0.64-0.66 when a modality was removed. In contrast, the Cross-Modal Transformer achieved a Kappa of 0.75 and accuracy of 81.3 with all modalities present and demonstrated graceful degradation, with scores of 0.74 when missing EMG, 0.73 when missing EOG, and a strong 0.72 when relying on EEG only. Future work will explore real-time implementation, investigate the framework's adaptability to other physiological signals, and evaluate its performance on more diverse and larger datasets from real-world, at-home monitoring scenarios.

George Mason University
George Mason University (US)
Openalex Percentile: Top 24%
Archaeological Research and Protection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.