Structured contrastive Self-Supervised representation learning for multimodal physiological stress detection

Stress is a pervasive physiological response to environmental and cognitive demands and is strongly associated with adverse physical and mental health outcomes. Wearable biosensors enable continuous and unobtrusive stress monitoring; however, learning robust and generalizable representations from multimodal physiological data remains challenging due to limited labeled samples, strong inter-feature correlations, and heterogeneous modality structure. While self-supervised learning (SSL) provides an effective paradigm for leveraging unlabeled data, existing tabular contrastive approaches typically rely on feature-independent augmentations that disregard physiological organization and modality-specific characteristics encountered in wearable sensing. This study introduces Structured Feature Corruption (SFC), a physiology-aware augmentation strategy for contrastive self-supervised representation learning in multimodal physiological stress detection. Instead of corrupting features independently, SFC applies modality-level corruption (e.g., heart rate and electrodermal activity), preserving intra-modality dependencies while encouraging informative invariances. The proposed framework follows a two-stage pipeline comprising contrastive pre-training on unlabeled data and supervised fine-tuning using limited labeled samples. The approach is evaluated on two multimodal physiological tabular datasets, StressData and SynthesizedStressData. Results show that SFC consistently outperforms established baselines, including SCARF, TabCLR, and VIME. SFC achieves an accuracy of 85.12% on StressData and 87.43% on SynthesizedStressData, demonstrating robust performance across datasets and corruption levels. Representation and explainability analyses further indicate improved class separability and physiologically meaningful feature contributions. These findings demonstrate that incorporating domain-specific multimodal structure into contrastive learning enhances stress detection without increasing model complexity.

Authors

Institutions

Publication Details

Journal
Biomedical Signal Processing and Control
Published
2026-08-25
DOI
https://doi.org/10.1016/j.bspc.2026.111372
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Structured contrastive Self-Supervised representation learning for multimodal physiological stress detection

Bessam Abdulrazak, Edouard Niyongabo
Biomedical Signal Processing and Control
Emotion and Mood Recognition
article

Structured contrastive Self-Supervised representation learning for multimodal physiological stress detection

Bessam Abdulrazak, Edouard Niyongabo
article en

Abstract

Stress is a pervasive physiological response to environmental and cognitive demands and is strongly associated with adverse physical and mental health outcomes. Wearable biosensors enable continuous and unobtrusive stress monitoring; however, learning robust and generalizable representations from multimodal physiological data remains challenging due to limited labeled samples, strong inter-feature correlations, and heterogeneous modality structure. While self-supervised learning (SSL) provides an effective paradigm for leveraging unlabeled data, existing tabular contrastive approaches typically rely on feature-independent augmentations that disregard physiological organization and modality-specific characteristics encountered in wearable sensing. This study introduces Structured Feature Corruption (SFC), a physiology-aware augmentation strategy for contrastive self-supervised representation learning in multimodal physiological stress detection. Instead of corrupting features independently, SFC applies modality-level corruption (e.g., heart rate and electrodermal activity), preserving intra-modality dependencies while encouraging informative invariances. The proposed framework follows a two-stage pipeline comprising contrastive pre-training on unlabeled data and supervised fine-tuning using limited labeled samples. The approach is evaluated on two multimodal physiological tabular datasets, StressData and SynthesizedStressData. Results show that SFC consistently outperforms established baselines, including SCARF, TabCLR, and VIME. SFC achieves an accuracy of 85.12% on StressData and 87.43% on SynthesizedStressData, demonstrating robust performance across datasets and corruption levels. Representation and explainability analyses further indicate improved class separability and physiologically meaningful feature contributions. These findings demonstrate that incorporating domain-specific multimodal structure into contrastive learning enhances stress detection without increasing model complexity.

Biomedical Signal Processing and ControlVol. 129
Université de Sherbrooke (CA)
Openalex Percentile: Top 7%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.