Graph transformer Q-network for collaborative governance and decentralized decision-making in multi-intersection networks

Coordinated traffic signal control along urban corridors is critical for reducing stop-and-go waves, vehicle delay, and queue spillback, yet remains challenging under large-scale topology, partial observability, and stochastic demand. Existing MARL controllers often rely on dense or static inter-intersection communication and locally scoped rewards, which weakens corridor-level credit assignment and leads to attention diffusion and unstable coordination as network scale grows. We propose the Graph Transformer Q-Network (GTQN) that learns a state-dependent sparse interaction graph for coordination and couples it with centralized governance during training so that decentralized controllers can reliably form and sustain corridor progression. Concretely, GTQN (i) learns which upstream/downstream peers are causally influential at each decision step via a two-stage mechanism (discrete peer gating followed by soft relevance weighting), yielding sparse, interpretable coordination without attention diffusion; (ii) uses a unified graph-transformer backbone to jointly encode network topology and temporal history so delayed upstream-to-downstream effects that determine green-wave formation are represented within the value function; and (iii) introduces a Collaborative Governance Graph (CTDE) trained with a progression-oriented two-level reward that couples junction efficiency with a corridor hindrance penalty, improving credit assignment and learning stability. Experiments on synthetic and real-world urban networks, including a 100-intersection Chengdu network, show that GTQN consistently improves progression quality, achieving the lowest Average Number of Stops (e.g., ANS [Formula: see text] on SQ1 and [Formula: see text] on SQ3) while reducing waiting time and queues and increasing throughput. Ablations confirm that learned sparsity, unified spatiotemporal encoding, and centralized governance are each necessary for scalable and progression-aware coordination. Robustness study demonstrates that GTQN maintains acceptable performance under moderate communication perturbations such as message dropout and delays. Code for this study is archived at https://doi.org/10.5281/zenodo.18885573.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-03-31
DOI
https://doi.org/10.1038/s41598-026-45895-2
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Graph transformer Q-network for collaborative governance and decentralized decision-making in multi-intersection networks

He Zhang
Scientific Reports
Advanced Graph Neural Networks
article

Graph transformer Q-network for collaborative governance and decentralized decision-making in multi-intersection networks

He Zhang
article en

Abstract

Coordinated traffic signal control along urban corridors is critical for reducing stop-and-go waves, vehicle delay, and queue spillback, yet remains challenging under large-scale topology, partial observability, and stochastic demand. Existing MARL controllers often rely on dense or static inter-intersection communication and locally scoped rewards, which weakens corridor-level credit assignment and leads to attention diffusion and unstable coordination as network scale grows. We propose the Graph Transformer Q-Network (GTQN) that learns a state-dependent sparse interaction graph for coordination and couples it with centralized governance during training so that decentralized controllers can reliably form and sustain corridor progression. Concretely, GTQN (i) learns which upstream/downstream peers are causally influential at each decision step via a two-stage mechanism (discrete peer gating followed by soft relevance weighting), yielding sparse, interpretable coordination without attention diffusion; (ii) uses a unified graph-transformer backbone to jointly encode network topology and temporal history so delayed upstream-to-downstream effects that determine green-wave formation are represented within the value function; and (iii) introduces a Collaborative Governance Graph (CTDE) trained with a progression-oriented two-level reward that couples junction efficiency with a corridor hindrance penalty, improving credit assignment and learning stability. Experiments on synthetic and real-world urban networks, including a 100-intersection Chengdu network, show that GTQN consistently improves progression quality, achieving the lowest Average Number of Stops (e.g., ANS [Formula: see text] on SQ1 and [Formula: see text] on SQ3) while reducing waiting time and queues and increasing throughput. Ablations confirm that learned sparsity, unified spatiotemporal encoding, and centralized governance are each necessary for scalable and progression-aware coordination. Robustness study demonstrates that GTQN maintains acceptable performance under moderate communication perturbations such as message dropout and delays. Code for this study is archived at https://doi.org/10.5281/zenodo.18885573.

Scientific Reports
Suzhou Polytechnic Institute of Agriculture (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 8%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.