Systematic Review of Multimodal Fusion Strategies for Driver Fatigue Detection in Autonomous Vehicles

Driver fatigue remains a key safety issue in autonomous vehicles. Traditional unimodal methods face limitations: vision-based approaches are environment-sensitive, while EEG signals suffer from noise and poor cross-subject generalization. This review analyzes multimodal fusion strategies to address these challenges. Early fusion integrates low-level features (e.g., visual cues and physiological signals) for joint representation learning, enhancing real-time performance and cross-modal correlations. Late fusion dynamically adjusts modality weights using high-level predictions, improving robustness in changing environments. Experiments show early fusion achieves 92% accuracy in stable conditions, while late fusion reduces false alarms by 18% in dynamic scenarios. Deep learning architectures, particularly Transformer-based attention mechanisms and lightweight edge-compatible models, balance computational efficiency and accuracy. Future directions emphasize privacy-preserving federated learning and automotive-grade hardware-software co-design. By bridging laboratory prototypes with real-world needs, this work lays groundwork for holistic "fatigue intervention" systems in autonomous driving.

Publication Details

Journal
Springer Link (Chiba Institute of Technology)
Published
2025-09-08
DOI
https://doi.org/10.1051/itmconf/20257803014/pdf
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Systematic Review of Multimodal Fusion Strategies for Driver Fatigue Detection in Autonomous Vehicles

Springer Link (Chiba Institute of Technology)
Geochemistry and Geologic Mapping
article

Systematic Review of Multimodal Fusion Strategies for Driver Fatigue Detection in Autonomous Vehicles

article en

Abstract

Driver fatigue remains a key safety issue in autonomous vehicles. Traditional unimodal methods face limitations: vision-based approaches are environment-sensitive, while EEG signals suffer from noise and poor cross-subject generalization. This review analyzes multimodal fusion strategies to address these challenges. Early fusion integrates low-level features (e.g., visual cues and physiological signals) for joint representation learning, enhancing real-time performance and cross-modal correlations. Late fusion dynamically adjusts modality weights using high-level predictions, improving robustness in changing environments. Experiments show early fusion achieves 92% accuracy in stable conditions, while late fusion reduces false alarms by 18% in dynamic scenarios. Deep learning architectures, particularly Transformer-based attention mechanisms and lightweight edge-compatible models, balance computational efficiency and accuracy. Future directions emphasize privacy-preserving federated learning and automotive-grade hardware-software co-design. By bridging laboratory prototypes with real-world needs, this work lays groundwork for holistic "fatigue intervention" systems in autonomous driving.

Springer Link (Chiba Institute of Technology)
Openalex Percentile: Top 44%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Systematic Review of Multimodal Fusion Strategies for Driver Fatigue Detection in Autonomous Vehicles · Springer Link (Chiba Institute of Technology) (2025) | TGRS Research Map | TGRS