Adaptive traffic signal control using deep reinforcement learning: A multi-objective approach for single and multi-intersection scenarios

Traffic congestion in urban networks necessitates adaptive signal control systems that balance efficiency, safety, and environmental impact. While Deep Reinforcement Learning (DRL) has shown promise for traffic signal control (TSC), existing approaches often optimize single objectives or lack scalability for multi-intersection corridors. This study proposes a multi-objective DRL framework that simultaneously minimizes vehicle delays, traffic conflicts (using Time-to-Collision metrics), and CO₂ emissions. Six reward functions were designed and tested with three DRL algorithms (PPO, A2C, DQN) in synthetic and real-world intersections simulated in SUMO. Key results demonstrate that: (1) PPO outperformed A2C and DQN, achieving up to 21 % fewer conflicts and 7 % lower delays in high-traffic scenarios; (2) A safety-focused reward (Reward 3) reduced conflicts by 4–20 % compared to fixed-time controls in high-traffic scenarios, while multi-objective rewards (Rewards 5–6) balanced all targets effectively; and (3) Decentralized control for multi-intersection corridor reduced delays, conflicts, and emissions by 26.4 %, 26.9 %, and 12 %, respectively, surpassing centralized approaches. Real-world validation in Hangzhou, China, and Cologne, Germany, confirmed robustness, with 10–15 % delay reductions and 2.2–6.4 % lower emissions versus prior DRL models. This work advances adaptive TSC by integrating safety and sustainability into DRL optimization, offering scalable solutions for heterogeneous traffic networks. • Deep Reinforcement Learning (DRL) framework with six reward functions targeting traffic delay, safety, and CO₂ emissions. • Developed and tested multi-objective reward functions to balance mobility, safety, and environmental sustainability. • Evaluated three DRL algorithms—PPO, A2C, and DQN—across synthetic traffic scenarios. • Improved delays (10-15%), conflicts (8-14%), and CO₂ (2.2-6.4%) at two real-world intersections. • Extended traffic control from single intersections to a full corridor using decentralized and centralized approaches.

Authors

Institutions

Publication Details

Journal
IATSS Research
Published
2025-10-24
DOI
https://doi.org/10.1016/j.iatssr.2025.10.004
Citations
3
Primary Topic
Traffic control and management
Type
article
Field-Weighted Citation Impact
3.64
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive traffic signal control using deep reinforcement learning: A multi-objective approach for single and multi-intersection scenarios

Sherif M. El-Badawy, Marwa Elharoun, Usama Elrawy Shahdah, Elsayed Abd-Elazem Shwaly
3 citations
IATSS Research
Traffic control and management
3.64
article

Adaptive traffic signal control using deep reinforcement learning: A multi-objective approach for single and multi-intersection scenarios

Sherif M. El-Badawy, Marwa Elharoun, Usama Elrawy Shahdah, Elsayed Abd-Elazem Shwaly
article en
3 citations

Abstract

Traffic congestion in urban networks necessitates adaptive signal control systems that balance efficiency, safety, and environmental impact. While Deep Reinforcement Learning (DRL) has shown promise for traffic signal control (TSC), existing approaches often optimize single objectives or lack scalability for multi-intersection corridors. This study proposes a multi-objective DRL framework that simultaneously minimizes vehicle delays, traffic conflicts (using Time-to-Collision metrics), and CO₂ emissions. Six reward functions were designed and tested with three DRL algorithms (PPO, A2C, DQN) in synthetic and real-world intersections simulated in SUMO. Key results demonstrate that: (1) PPO outperformed A2C and DQN, achieving up to 21 % fewer conflicts and 7 % lower delays in high-traffic scenarios; (2) A safety-focused reward (Reward 3) reduced conflicts by 4–20 % compared to fixed-time controls in high-traffic scenarios, while multi-objective rewards (Rewards 5–6) balanced all targets effectively; and (3) Decentralized control for multi-intersection corridor reduced delays, conflicts, and emissions by 26.4 %, 26.9 %, and 12 %, respectively, surpassing centralized approaches. Real-world validation in Hangzhou, China, and Cologne, Germany, confirmed robustness, with 10–15 % delay reductions and 2.2–6.4 % lower emissions versus prior DRL models. This work advances adaptive TSC by integrating safety and sustainability into DRL optimization, offering scalable solutions for heterogeneous traffic networks. • Deep Reinforcement Learning (DRL) framework with six reward functions targeting traffic delay, safety, and CO₂ emissions. • Developed and tested multi-objective reward functions to balance mobility, safety, and environmental sustainability. • Evaluated three DRL algorithms—PPO, A2C, and DQN—across synthetic traffic scenarios. • Improved delays (10-15%), conflicts (8-14%), and CO₂ (2.2-6.4%) at two real-world intersections. • Extended traffic control from single intersections to a full corridor using decentralized and centralized approaches.

IATSS ResearchVol. 49(4)
Mansoura University (EG)
Openalex Percentile: Top 6%
Traffic control and management
3.64
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.