ELI: A Conversational LLM-Based Interface for Human–AI Driving Teams and Its Impact on Performance and Driver Status

Highly automated vehicles often rely on takeover requests (TORs) that lack contextual transparency, treat drivers as passive fallbacks, and lead to poor situational awareness. To address this challenge, this study presents the Empowering Language Interaction (ELI) framework, a conversational interface powered by a large language model that supports bidirectional negotiation and collaborative human–AI teamwork. Using the CARLA driving simulator, 28 participants compared ELI with a conventional TOR baseline in both urban and peri-urban driving scenarios. The study employed a multidimensional evaluation approach, integrating telemetry data on driving performance with continuous monitoring of physiological indicators (electrocardiogram and electrodermal activity) and subjective questionnaires to assess driver trust and engagement. Results indicated that ELI sustained continuous driver engagement and improved the subjective comprehension of the vehicle’s state. Physiologically, the conversational interface maintained active cognitive load, preventing the abrupt autonomic spikes characteristic of traditional takeover requests. Furthermore, ELI outperformed the TOR baseline in safety metrics by reducing out-of-lane events and maintaining greater safety margins. Conversational interaction has shown potential to transform drivers from passive supervisors into active teammates, improving joint decision-making without inducing over-reliance on the automated system.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-08-18
DOI
https://doi.org/10.3390/s26165228
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ELI: A Conversational LLM-Based Interface for Human–AI Driving Teams and Its Impact on Performance and Driver Status

Juan C. Peña, Juan Felipe Medina Lee, Iyadunni J. Adenuga, Evelyn Vásquez et al.
Sensors
Human-Automation Interaction and Safety
article

ELI: A Conversational LLM-Based Interface for Human–AI Driving Teams and Its Impact on Performance and Driver Status

Juan C. Peña, Juan Felipe Medina Lee, Iyadunni J. Adenuga, Evelyn Vásquez, Alanis Negroni
article en

Abstract

Highly automated vehicles often rely on takeover requests (TORs) that lack contextual transparency, treat drivers as passive fallbacks, and lead to poor situational awareness. To address this challenge, this study presents the Empowering Language Interaction (ELI) framework, a conversational interface powered by a large language model that supports bidirectional negotiation and collaborative human–AI teamwork. Using the CARLA driving simulator, 28 participants compared ELI with a conventional TOR baseline in both urban and peri-urban driving scenarios. The study employed a multidimensional evaluation approach, integrating telemetry data on driving performance with continuous monitoring of physiological indicators (electrocardiogram and electrodermal activity) and subjective questionnaires to assess driver trust and engagement. Results indicated that ELI sustained continuous driver engagement and improved the subjective comprehension of the vehicle’s state. Physiologically, the conversational interface maintained active cognitive load, preventing the abrupt autonomic spikes characteristic of traditional takeover requests. Furthermore, ELI outperformed the TOR baseline in safety metrics by reducing out-of-lane events and maintaining greater safety margins. Conversational interaction has shown potential to transform drivers from passive supervisors into active teammates, improving joint decision-making without inducing over-reliance on the automated system.

SensorsVol. 26(16)
Kean University (US), University of Puerto Rico-Mayaguez (PR)
Openalex Percentile: Top 6%
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.