Entropic harmony: Graph-based multi-agent reinforcement learning with dynamic decay for mixed traffic in highway

The evolution of intelligent transportation systems is driving a paradigm shift in highway driving from isolated individual intelligence to collaborative swarm intelligence. However, realizing efficient coordination in mixed traffic flows remains impeded by two critical challenges: the non-stationarity of reward signals, which leads to inconsistent cooperative behaviors, and the overwhelming perceptual noise within complex vehicle interaction topologies. To bridge these gaps, this paper proposes a robust Multi-Agent Reinforcement Learning framework incorporating Adaptive Reward Entropy and Dynamic Graph Attention. First, to address the instability in coordination, we devise a Reward Entropy mechanism with a Sliding-Window Coordination Factor. Unlike static historical baselines, this approach dynamically tracks local reward extrema to calibrate entropy regularization, effectively guiding the transition from disordered individual exploration to synchronized group performance. Second, to tackle environmental noise, we introduce a Graph-Structure-Based Multi-Head Attention Network equipped with a Dynamic Decay Adapter. By modeling vehicle interactions as a topological graph, this module precisely extracts critical spatial-temporal dependencies while automatically attenuating irrelevant interference from distant vehicles. Extensive evaluations in the CARLA simulation platform demonstrate that our method exhibits highly competitive coordination efficiency and robust convergence characteristics across varying traffic densities compared to established multi-agent baselines.

Authors

Institutions

Publication Details

Journal
Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering
Published
2026-09-25
DOI
https://doi.org/10.1177/09544070261487592
Primary Topic
Traffic control and management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Entropic harmony: Graph-based multi-agent reinforcement learning with dynamic decay for mixed traffic in highway

Shidong Liang, Minghui Ma, Wei Li, Kuo Yu
Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering
Traffic control and management
article

Entropic harmony: Graph-based multi-agent reinforcement learning with dynamic decay for mixed traffic in highway

Shidong Liang, Minghui Ma, Wei Li, Kuo Yu
article en

Abstract

The evolution of intelligent transportation systems is driving a paradigm shift in highway driving from isolated individual intelligence to collaborative swarm intelligence. However, realizing efficient coordination in mixed traffic flows remains impeded by two critical challenges: the non-stationarity of reward signals, which leads to inconsistent cooperative behaviors, and the overwhelming perceptual noise within complex vehicle interaction topologies. To bridge these gaps, this paper proposes a robust Multi-Agent Reinforcement Learning framework incorporating Adaptive Reward Entropy and Dynamic Graph Attention. First, to address the instability in coordination, we devise a Reward Entropy mechanism with a Sliding-Window Coordination Factor. Unlike static historical baselines, this approach dynamically tracks local reward extrema to calibrate entropy regularization, effectively guiding the transition from disordered individual exploration to synchronized group performance. Second, to tackle environmental noise, we introduce a Graph-Structure-Based Multi-Head Attention Network equipped with a Dynamic Decay Adapter. By modeling vehicle interactions as a topological graph, this module precisely extracts critical spatial-temporal dependencies while automatically attenuating irrelevant interference from distant vehicles. Extensive evaluations in the CARLA simulation platform demonstrate that our method exhibits highly competitive coordination efficiency and robust convergence characteristics across varying traffic densities compared to established multi-agent baselines.

Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering
Shanghai University of Engineering Science (CN), University of Shanghai for Science and Technology (CN), First Automotive Works (China) (CN)
Openalex Percentile: Top 16%
Traffic control and management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Entropic harmony: Graph-based multi-agent reinforcement learning with dynamic decay for mixed traffic in highway — Shidong Liang, Minghui Ma, et al. · Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering (2026) | TGRS Research Map | TGRS