Reinforcement Learning Approach for Highway Lane-Changing: PPO-Based Strategy Design
This paper presents a novel approach to highway lane-changing using reinforcement learning, specifically employing the Proximal Policy Optimization (PPO) algorithm. The proposed strategy aims to enhance the safety, efficiency, and smoothness of lane changes in high-speed driving environments. By modeling the lane-changing task as a Markov Decision Process (MDP), the PPO-based agent learns an optimal policy through continuous interaction with a simulated highway environment. Extensive experiments demonstrate that the trained policy effectively balances the trade-off between aggressive and conservative maneuvers, adapting dynamically to surrounding traffic conditions. The results indicate that the PPO-driven strategy outperforms traditional rule-based methods in terms of maneuver success rate, travel time, and passenger comfort. This work contributes to the advancement of autonomous driving technologies by providing a robust and adaptive lane-changing solution leveraging state-of-the-art reinforcement learning techniques.
Authors
- Yuchen Yang (ORCID: https://orcid.org/0009-0006-0739-0410)
- Zhichao Ma (ORCID: https://orcid.org/0000-0001-6063-6770)
- Hao Liu (ORCID: https://orcid.org/0000-0002-6717-9784)
- Zheyu Zhang (ORCID: https://orcid.org/0000-0003-3376-8019)
- Yutong Luo
- A. Y. Sun (ORCID: https://orcid.org/0009-0007-5784-8167)
Publication Details
- Published
- 2025-06-27
- DOI
- https://doi.org/10.1109/icetis66286.2025.11144414
- Citations
- 1
- Primary Topic
- Traffic control and management
- Type
- article
- Field-Weighted Citation Impact
- 1.21