Recent Advances of Reinforcement Learning Algorithms for Autonomous Driving System
Abstract Reinforcement learning (RL) is being studied for autonomous driving (AD), but its value depends on the role it plays in a task, the action interface, the evaluation protocol, and the evidence from deployment. This survey examines RL-based AD in modular and end-to-end pipelines and relates reported methods to task formulation and deployment evidence. It maps safe RL, offline RL, model-based RL, and PPO/GRPO-style fine-tuning to maneuver selection, continuous control, world modeling, and VLM/VLA-based driving. It also reviews simulators, datasets, RL platforms, and VLA benchmarks, with attention to reward design, observation space, traffic complexity, and open-loop versus closed-loop evaluation. The survey then examines deployment barriers, including safety, Sim2Real generalization, data efficiency, computation, embodied alignment, and evaluation readiness. RL and VLM/VLA-based methods have shown promise, but current evidence is insufficient to support reliable real-world deployment: many reported results come from restricted scenarios and depend on engineered rewards or simulator assumptions.
Authors
- Zhilong Zheng (ORCID: https://orcid.org/0009-0005-1907-1882)
- Xianyuan Zhan (ORCID: https://orcid.org/0000-0002-3683-0554)
- Bin Shuai (ORCID: https://orcid.org/0000-0002-2323-5158)
- Min Hua (ORCID: https://orcid.org/0009-0004-2071-3806)
- Jingliang Duan (ORCID: https://orcid.org/0000-0002-3697-1576)
- Letian Tao (ORCID: https://orcid.org/0000-0002-0622-2208)
- Shengbo Eben Li (ORCID: https://orcid.org/0000-0003-4923-3633)
- Yujie Yang (ORCID: https://orcid.org/0000-0001-7222-0019)
- Jiaxin Gao (ORCID: https://orcid.org/0000-0002-0023-1269)
- Shuo Feng
- Jincheng Yu
- Lei He
- Yang Yu
- Haifeng Zhang
- Yang Guan
Publication Details
- Journal
- Communications in Transportation Research
- Published
- 2026-09-09
- DOI
- https://doi.org/10.26599/commtr.2026.9640053
- Primary Topic
- Autonomous Vehicle Technology and Safety
- Type
- article
- Field-Weighted Citation Impact
- 0.00