Graph Attention Network-Based Multi-Agent Reinforcement Learning for Traffic Signal Priority Control
Reinforcement learning (RL) is widely applied to the problem of adaptive traffic signal control (ATSC). This paper presents an efficient RL algorithm to address ATSC issues. We adopt the decentralized multi-agent advantage actor-critic (A2C) algorithm, where distributed control methods introduce new challenges: the environment becomes partially observable for each local agent. To tackle this issue, we incorporate spatial infor-mation from neighboring agents using graph attention networks (GAT) to learn collaborative control strategies. Additionally, to better adapt to real-world road environments, we propose a hybrid reward function model. This model ensures the traffic efficiency for social vehicles while emphasizing the priority of emergency vehicles (EMV), thereby reducing their travel time. We numerically evaluate the proposed method in a simulated environment containing 25 intersections. Experimental results demonstrate that the approach presented in this paper has significant advantages compared to similar algorithms applied to multi-agent ATSC.
Authors
- Zhongwen Xing (ORCID: https://orcid.org/0000-0001-7092-5023)
- Hao Zhao (ORCID: https://orcid.org/0000-0003-4302-3758)
- Jie Luo (ORCID: https://orcid.org/0000-0003-2584-056X)
Institutions
- Nanjing University (CN)
Publication Details
- Published
- 2024-11-01
- DOI
- https://doi.org/10.1109/cac63892.2024.10864521
- Citations
- 1
- Primary Topic
- Traffic Prediction and Management Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.27