Driver Situational Awareness Prediction During Takeover Transitions: A Multimodal Machine Learning Approach

This study predicts drivers’ situational awareness (SA) of specific traffic elements during takeover transitions in Level 3 automated vehicles. Using a simulator dataset from 44 participants, we analyzed multimodal features, including driver characteristics, physiological data, eye movement, and environmental attributes. Various machine learning models (e.g., SVM, Logistic Regression, and XGBoost) were optimized through feature selection and time window tuning. The SVM model, using a 3-second post-TOR and 1-second pre-TOR window, achieved the best performance with a macro F1 score of 0.75 and 0.77 accuracy. Our approach highlights the importance of comprehensive feature sets and timely predictions for improving driver support systems. This model aids in identifying potential hazards and enhances takeover readiness, contributing to safer autonomous driving transitions.

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2024-08-29
DOI
https://doi.org/10.1177/10711813241275904
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Driver Situational Awareness Prediction During Takeover Transitions: A Multimodal Machine Learning Approach

Na Du, Lesong Jia
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Human-Automation Interaction and Safety
article

Driver Situational Awareness Prediction During Takeover Transitions: A Multimodal Machine Learning Approach

Na Du, Lesong Jia
article en

Abstract

This study predicts drivers’ situational awareness (SA) of specific traffic elements during takeover transitions in Level 3 automated vehicles. Using a simulator dataset from 44 participants, we analyzed multimodal features, including driver characteristics, physiological data, eye movement, and environmental attributes. Various machine learning models (e.g., SVM, Logistic Regression, and XGBoost) were optimized through feature selection and time window tuning. The SVM model, using a 3-second post-TOR and 1-second pre-TOR window, achieved the best performance with a macro F1 score of 0.75 and 0.77 accuracy. Our approach highlights the importance of comprehensive feature sets and timely predictions for improving driver support systems. This model aids in identifying potential hazards and enhances takeover readiness, contributing to safer autonomous driving transitions.

Proceedings of the Human Factors and Ergonomics Society Annual MeetingVol. 68(1)
University of Pittsburgh (US)
Openalex Percentile: Top 82%
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.