Multi-Agent Deep Reinforcement Learning for Efficient Vehicular Mobility via Federated Fog Computing

Optimizing vehicle waiting time is essential for an intelligent intersection management system as it directly influences traffic flow, public safety, and overall network performance. Conventional emergency vehicle management methods rely on static rules that are unable to adapt to dynamic traffic conditions. This paper presents MADQL-FFC, a multi-agent deep Q-learning framework combined with federated fog computing for real-time traffic signal control at the intersection that prioritizes emergency vehicles. In this framework, deep Q-network agents are deployed at individual intersections to make localized decisions, while a federated fog computing architecture is used in information sharing among neighboring agents for coordinated decision making. This helps in decentralized, low-latency coordination across the traffic network without the need for centralized control. The proposed approach is evaluated using realistic traffic simulations based on OpenStreetMap data of Gwalior City, India, implemented in the Simulation of Urban Mobility (SUMO) simulator. Comparative results against state-of-the-art methods demonstrate that MADQL-FFC achieves reductions in waiting time for all vehicle categories. Overall, the proposed model achieves a performance improvement of 5% to 32%, 12% to 44%, 4% to 46%, and 13% to 38% in average waiting time, average vehicle speed, average queue length, and average throughput respectively, when compared to state of the art methods.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Cyber-Physical Systems
Published
2025-06-18
DOI
https://doi.org/10.1145/3744349
Primary Topic
Traffic Prediction and Management Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Agent Deep Reinforcement Learning for Efficient Vehicular Mobility via Federated Fog Computing

Neetesh Kumar, Pramod Kumar Singh, Ashok Pratap Arora
ACM Transactions on Cyber-Physical Systems
Traffic Prediction and Management Techniques
article

Multi-Agent Deep Reinforcement Learning for Efficient Vehicular Mobility via Federated Fog Computing

Neetesh Kumar, Pramod Kumar Singh, Ashok Pratap Arora
article en

Abstract

Optimizing vehicle waiting time is essential for an intelligent intersection management system as it directly influences traffic flow, public safety, and overall network performance. Conventional emergency vehicle management methods rely on static rules that are unable to adapt to dynamic traffic conditions. This paper presents MADQL-FFC, a multi-agent deep Q-learning framework combined with federated fog computing for real-time traffic signal control at the intersection that prioritizes emergency vehicles. In this framework, deep Q-network agents are deployed at individual intersections to make localized decisions, while a federated fog computing architecture is used in information sharing among neighboring agents for coordinated decision making. This helps in decentralized, low-latency coordination across the traffic network without the need for centralized control. The proposed approach is evaluated using realistic traffic simulations based on OpenStreetMap data of Gwalior City, India, implemented in the Simulation of Urban Mobility (SUMO) simulator. Comparative results against state-of-the-art methods demonstrate that MADQL-FFC achieves reductions in waiting time for all vehicle categories. Overall, the proposed model achieves a performance improvement of 5% to 32%, 12% to 44%, 4% to 46%, and 13% to 38% in average waiting time, average vehicle speed, average queue length, and average throughput respectively, when compared to state of the art methods.

ACM Transactions on Cyber-Physical Systems
Indian Institute of Technology Roorkee (IN), Atal Bihari Vajpayee Indian Institute of Information Technology and Management (IN)
Sustainable cities and communities
Openalex Percentile: Top 86%
Traffic Prediction and Management Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi-Agent Deep Reinforcement Learning for Efficient Vehicular Mobility via Federated Fog Computing — Neetesh Kumar, Pramod Kumar Singh, et al. · ACM Transactions on Cyber-Physical Systems (2025) | TGRS Research Map | TGRS