Research on Lane Changing Decision of Intelligent Driving Vehicles Based on Improved Deep Reinforcement Learning

With the rapid development of autonomous driving technology, decision-making capability in complex road environments has become a crucial research focus. In highway scenarios, lane-changing is a key behavior that directly impacts driving safety and efficiency. This paper proposes an improved lane-changing decision-making method based on the Deep QNetwork (DQN) reinforcement learning algorithm. To address the problem of Q-value overestimation in traditional DQN, we adopt the Double DQN (DDQN) framework, which separates the selection and evaluation of actions. Experiments are conducted using the real-world high D highway trajectory dataset, where the state space is composed of 13 features including vehicle velocity, acceleration, distance, and relative speed to surrounding vehicles. The action space consists of three lane-change decisions: left, stay, and right. Experimental results show that the improved DDQN model significantly outperforms the original DQN in terms of accuracy, F1-score, collision rate, and success rate, thereby enhancing the safety and reliability of autonomous lane-changing decisions. The proposed method offers an effective reinforcement learning-based solution for intelligent driving decision-making systems.

Authors

Institutions

Publication Details

Published
2025-06-27
DOI
https://doi.org/10.1109/icaita67588.2025.11137850
Primary Topic
Simulation and Modeling Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Lane Changing Decision of Intelligent Driving Vehicles Based on Improved Deep Reinforcement Learning

Tao Peng, Jicong Liu, Cheng Li, Long Wang
Simulation and Modeling Applications
article

Research on Lane Changing Decision of Intelligent Driving Vehicles Based on Improved Deep Reinforcement Learning

Tao Peng, Jicong Liu, Cheng Li, Long Wang
article en

Abstract

With the rapid development of autonomous driving technology, decision-making capability in complex road environments has become a crucial research focus. In highway scenarios, lane-changing is a key behavior that directly impacts driving safety and efficiency. This paper proposes an improved lane-changing decision-making method based on the Deep QNetwork (DQN) reinforcement learning algorithm. To address the problem of Q-value overestimation in traditional DQN, we adopt the Double DQN (DDQN) framework, which separates the selection and evaluation of actions. Experiments are conducted using the real-world high D highway trajectory dataset, where the state space is composed of 13 features including vehicle velocity, acceleration, distance, and relative speed to surrounding vehicles. The action space consists of three lane-change decisions: left, stay, and right. Experimental results show that the improved DDQN model significantly outperforms the original DQN in terms of accuracy, F1-score, collision rate, and success rate, thereby enhancing the safety and reliability of autonomous lane-changing decisions. The proposed method offers an effective reinforcement learning-based solution for intelligent driving decision-making systems.

Tianjin University of Technology and Education (CN), Tianjin University of Technology (CN)
Openalex Percentile: Top 71%
Simulation and Modeling Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Lane Changing Decision of Intelligent Driving Vehicles Based on Improved Deep Reinforcement Learning — Tao Peng, Jicong Liu, et al. · (2025) | TGRS Research Map | TGRS