Research on intelligent stochastic traffic flow model based on deep reinforcement learning

In order to quickly form richer simulation scenarios, this paper proposes a method for training a stochastic traffic flow model based on deep reinforcement learning DQN (DeepQ-Network), which can integrate the generated model into a simulation loop for testing intelligent driving algorithms. Firstly, a training environment was constructed based on a two-degree-of-freedom dynamic model, a random rigid object moving target, and a three-lane road. Then, through different reward function designs, three intelligent stochastic traffic models, namely cautious, balanced, and aggressive, were trained. Finally, multiple types of traffic agents were integrated in the CarMaker simulation software to form a stochastic traffic flow, which verified the interactivity and effectiveness of the model. The results show that the model trained using deep reinforcement learning algorithm can effectively generate random scenarios quickly, greatly improving the coverage of simulation test scenarios.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1145/3704657.3704677
Primary Topic
Traffic Prediction and Management Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on intelligent stochastic traffic flow model based on deep reinforcement learning

S. Chen, Guoping Xu, Wei Qiang, Chen Chen et al.
Traffic Prediction and Management Techniques
article

Research on intelligent stochastic traffic flow model based on deep reinforcement learning

S. Chen, Guoping Xu, Wei Qiang, Chen Chen, Jingwen Fu, Dandan Lv
article en

Abstract

In order to quickly form richer simulation scenarios, this paper proposes a method for training a stochastic traffic flow model based on deep reinforcement learning DQN (DeepQ-Network), which can integrate the generated model into a simulation loop for testing intelligent driving algorithms. Firstly, a training environment was constructed based on a two-degree-of-freedom dynamic model, a random rigid object moving target, and a three-lane road. Then, through different reward function designs, three intelligent stochastic traffic models, namely cautious, balanced, and aggressive, were trained. Finally, multiple types of traffic agents were integrated in the CarMaker simulation software to form a stochastic traffic flow, which verified the interactivity and effectiveness of the model. The results show that the model trained using deep reinforcement learning algorithm can effectively generate random scenarios quickly, greatly improving the coverage of simulation test scenarios.

China Automotive Technology and Research Center (CN), China United Network Communications Group (China) (CN)
Openalex Percentile: Top 74%
Traffic Prediction and Management Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.