Mental State Adaptive Takeover Warnings for Automated Driving Using a RAG-Enabled Large Language Model
Conditionally automated vehicles may require drivers to resume control within seconds, but takeover warnings may not account for drivers’ mental states. This study developed and evaluated a retrieval-augmented generation (RAG) system that assigned mental-state categories to synthetic profiles and generated profile-tailored takeover warnings. A search of four databases identified 6,049 records, of which 150 publications formed the retrieval corpus. The system was tested with 24 profiles representing anger, sadness, happiness, fatigue, mind-wandering, and external distraction. For 20 profiles (83.3%), the assigned category met the prespecified criterion by matching the intended category or a prespecified acceptable alternative. Fourteen participants rated the messages. Overall perceived helpfulness averaged 4.86 on a 7-point scale. Ratings for anger, sadness, mind-wandering, and fatigue were significantly above the scale midpoint. The findings provide preliminary evidence that RAG can generate profile-tailored candidate warnings from synthetic profiles. Simulator studies using measured driver data are needed to evaluate takeover behavior.
Authors
- Gaojian Huang (ORCID: https://orcid.org/0000-0001-8139-7481)
- Yue Gang Luo (ORCID: https://orcid.org/0000-0002-0062-3190)
- Egbe-Etu Etu (ORCID: https://orcid.org/0000-0003-0457-6296)
- Guannan Liu (ORCID: https://orcid.org/0000-0002-4532-7109)
- Jenny Dinh-Tran
Institutions
- San Jose State University (US)
Publication Details
- Journal
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Published
- 2026-09-29
- DOI
- https://doi.org/10.1177/10711813261493628
- Primary Topic
- Human-Automation Interaction and Safety
- Type
- article
- Field-Weighted Citation Impact
- 0.00