Dream to Assist: Intent-Conditioned World Models for Shared Vehicle Control
Assistive agents in shared-control settings face a dual challenge: acting proactively to align with the human's intentions while remaining legible enough for the human to comprehend and fluently respond in real time. We present Dream2Assist, a model-based reinforcement learning framework for tightly-coupled shared decision making that addresses both sides of this challenge. Our approach extends a recurrent state-space world model with intent inference, enabling an assistive policy trained via fictitious co-play to anticipate and support discrete human objectives without overriding human agency. Beyond the computational framework, we describe the full deployment pipeline needed to translate a world-model-based policy into a safe, human-centered system in a resource-efficient way. Crucially, we address the sim-to-real-human gap via policy down-selection and reward restructuring within an iterative human-machine interface design. We validate the framework through three human-subjects studies and a preliminary on-vehicle deployment spanning two qualitatively distinct domains: high-speed racing (N=30) and urban driving with richer intent structure (N=10). Our results demonstrate that intent conditioning yields measurable improvements in torque alignment and collision rate. We surface key design insights and practices for deploying learning-based assistive agents in safety-critical, real-time human-robot teaming.
Authors
- Guy Rosman (ORCID: https://orcid.org/0000-0002-9334-1706)
- Elliot Weiss (ORCID: https://orcid.org/0000-0001-9822-9900)
- John Leonard
- Jonathan DeCastro (ORCID: https://orcid.org/0000-0002-0933-9671)
- Emily Sarah Sumner (ORCID: https://orcid.org/0000-0003-1912-9640)
- Deepak Gopinath (ORCID: https://orcid.org/0000-0002-5597-4860)
- Avinash Balachandran (ORCID: https://orcid.org/0000-0003-2270-8985)
- Laporsha Dees (ORCID: https://orcid.org/0009-0007-1566-6015)
- Todd Rowell (ORCID: https://orcid.org/0009-0009-0060-4465)
- Megan Applegate-Kenton (ORCID: https://orcid.org/0000-0001-8111-7312)
- Patricio Reyes Gomez
- Thomas Balch
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-10-26
- DOI
- https://doi.org/10.48550/arxiv.2610.34650
- Primary Topic
- Human-Automation Interaction and Safety
- Type
- preprint