Driving Decision-Making Method for Autonomous Vehicles Based on Anterior Cingulate Cortex Neural Regulation Mechanism

Reinforcement learning algorithms have been widely applied in the field of autonomous driving. However, the choice of policy during the reinforcement learning process significantly impacts learning outcomes. Existing stochastic policy methods lack flexibility, preventing autonomous vehicles from quickly learning optimal strategies in complex traffic environments. This paper proposes a model that simulates the regulatory mechanism of the Anterior Cingulate Cortex (ACC) to balance exploration and exploitation. The model observes through the Medial Prefrontal Cortex (MPFC) module, evaluates using graph convolutional neural networks, and transmits dopamine signals of reward errors to the ACC module. Feedback neurons compute vigilance, and the LPFC adjusts action probabilities based on vigilance and action values. Experimental results validate that this approach achieves a balance in action selection strategies for autonomous vehicles, thereby improving the quality of actions taken by the agent.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/icus61736.2024.10839811
Primary Topic
Simulation and Modeling Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Driving Decision-Making Method for Autonomous Vehicles Based on Anterior Cingulate Cortex Neural Regulation Mechanism

Yue Li, Jialin Liu, Xiaolan Wang
Simulation and Modeling Applications
article

Driving Decision-Making Method for Autonomous Vehicles Based on Anterior Cingulate Cortex Neural Regulation Mechanism

Yue Li, Jialin Liu, Xiaolan Wang
article en

Abstract

Reinforcement learning algorithms have been widely applied in the field of autonomous driving. However, the choice of policy during the reinforcement learning process significantly impacts learning outcomes. Existing stochastic policy methods lack flexibility, preventing autonomous vehicles from quickly learning optimal strategies in complex traffic environments. This paper proposes a model that simulates the regulatory mechanism of the Anterior Cingulate Cortex (ACC) to balance exploration and exploitation. The model observes through the Medial Prefrontal Cortex (MPFC) module, evaluates using graph convolutional neural networks, and transmits dopamine signals of reward errors to the ACC module. Feedback neurons compute vigilance, and the LPFC adjusts action probabilities based on vigilance and action values. Experimental results validate that this approach achieves a balance in action selection strategies for autonomous vehicles, thereby improving the quality of actions taken by the agent.

Shanghai University of Engineering Science (CN), Ministry of Transport (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 68%
Simulation and Modeling Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.