Hybrid Decision-making Strategy Combining Reinforcement Learning and Decision Rules for Highway Unmanned Driving

In recent years, reinforcement learning has been employed to address the challenge of unmanned driving decision-making, due to its ability to handle uncertainty and continuous optimization. However, compared with rule-based algorithms, its training time is considerable and the reliability of its results is difficult to guarantee. To enhance the security of decision-making processes, this paper proposes a hybrid decision-making algorithm designed to accelerate the training process of reinforcement learning and enhance the reliability of decision-making. The method first evaluates the confidence levels of both rule-based and learning-based strategies by leveraging the data collected throughout the training phase. Subsequently, an activation function is crafted to determine the final strategy with the greatest level of confidence. This guarantees that the final strategy performs at least on par with the rule-based approach. A simulation focused on highway driving was conducted as a case study to illustrate the effectiveness of the proposed method. The results demonstrate that the proposed approach offers greater profitability than the rule-based method and higher reliability compared to the learning-based method.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/icus61736.2024.10839935
Primary Topic
Autonomous Vehicle Technology and Safety
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid Decision-making Strategy Combining Reinforcement Learning and Decision Rules for Highway Unmanned Driving

Qingjia Cui, Yunshui Zhou, Ziniu Hu, Lele Zhang et al.
Autonomous Vehicle Technology and Safety
article

Hybrid Decision-making Strategy Combining Reinforcement Learning and Decision Rules for Highway Unmanned Driving

Qingjia Cui, Yunshui Zhou, Ziniu Hu, Lele Zhang, Zeyu Yang, C. X. Yu
article en

Abstract

In recent years, reinforcement learning has been employed to address the challenge of unmanned driving decision-making, due to its ability to handle uncertainty and continuous optimization. However, compared with rule-based algorithms, its training time is considerable and the reliability of its results is difficult to guarantee. To enhance the security of decision-making processes, this paper proposes a hybrid decision-making algorithm designed to accelerate the training process of reinforcement learning and enhance the reliability of decision-making. The method first evaluates the confidence levels of both rule-based and learning-based strategies by leveraging the data collected throughout the training phase. Subsequently, an activation function is crafted to determine the final strategy with the greatest level of confidence. This guarantees that the final strategy performs at least on par with the rule-based approach. A simulation focused on highway driving was conducted as a case study to illustrate the effectiveness of the proposed method. The results demonstrate that the proposed approach offers greater profitability than the rule-based method and higher reliability compared to the learning-based method.

Hunan University (CN), Wuxi Institute of Technology (CN)
National Natural Science Foundation of China
Peace, Justice and strong institutions
Openalex Percentile: Top 72%
Autonomous Vehicle Technology and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.