Multi-Intersection Deep Q-Learning for Adaptive Traffic Signal Coordination in Smart Urban Environments

Urbanization and rising vehicle density have worsened traffic congestion, commute times, fuel consumption, and pollution. Traditional traffic control systems—fixed timing and sensor-based fail to adapt to real-time traffic variations, causing inefficient phase switching and bottlenecks. The proposed model treats each intersection as an intelligent agent, using Markov Decision Processes (MDP) and Q-learning to adapt signals based on vehicle density, queue length, and congestion. Integrated with SUMO and trained via Python-based Deep Q-Networks (DQNs), the system uses a reward function that penalises delays and promotes high throughput and low fuel usage. Experimental results show an 80% congestion reduction, outperforming fixed timing (10%) and sensor-based systems (35%). Compared to other AI methods like Genetic Algorithms (70%) and Fuzzy Logic (50%), our model offers better adaptability (9/10 during peak hours) and pedestrian safety (9.5/10), making it ideal for scalable, smart city traffic control.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1109/icepe65965.2025.11139537
Primary Topic
Traffic Prediction and Management Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Intersection Deep Q-Learning for Adaptive Traffic Signal Coordination in Smart Urban Environments

S. Aurthy Felicita, Mani Deepak Choudhry, Akshya Jothi, M Sundarrajan et al.
Traffic Prediction and Management Techniques
article

Multi-Intersection Deep Q-Learning for Adaptive Traffic Signal Coordination in Smart Urban Environments

S. Aurthy Felicita, Mani Deepak Choudhry, Akshya Jothi, M Sundarrajan, Sri Harshini Devi Kaipa, K Saranya, D. Nandhini
article en

Abstract

Urbanization and rising vehicle density have worsened traffic congestion, commute times, fuel consumption, and pollution. Traditional traffic control systems—fixed timing and sensor-based fail to adapt to real-time traffic variations, causing inefficient phase switching and bottlenecks. The proposed model treats each intersection as an intelligent agent, using Markov Decision Processes (MDP) and Q-learning to adapt signals based on vehicle density, queue length, and congestion. Integrated with SUMO and trained via Python-based Deep Q-Networks (DQNs), the system uses a reward function that penalises delays and promotes high throughput and low fuel usage. Experimental results show an 80% congestion reduction, outperforming fixed timing (10%) and sensor-based systems (35%). Compared to other AI methods like Genetic Algorithms (70%) and Fuzzy Logic (50%), our model offers better adaptability (9/10 during peak hours) and pedestrian safety (9.5/10), making it ideal for scalable, smart city traffic control.

Karunya University (IN), SRM Institute of Science and Technology (IN), Horizon College and Seminary (CA), Social Service Sericulture Project Trust (IN), KPR Institute of Engineering and Technology (IN)
Openalex Percentile: Top 74%
Traffic Prediction and Management Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.