Adaptive traffic signal optimization with thermal sensors and reinforcement learning

• Real-world adaptive traffic signals with thermal sensors cut vehicle delays significantly • A new learning control system adjusts timing using traffic and environmental conditions • Safety guard rules ensure every signal change follows required road rules at all times • The learning system reduces fuel use and carbon emissions while improving travel times • Uses field data to build a realistic model that prepares the system for city deployment Static traffic signals remain a primary source of urban congestion, increasing vehicle delays and environmental impact. While reinforcement learning (RL) offers a promising solution, existing models often fail to address the multi-objective nature of traffic management, specifically by overlooking environmental costs and neglecting the operational safety guarantees required for real-world deployment. This study addresses this gap by introducing a novel, safety-first adaptive control framework, validated through a two-stage methodology. Initially, a rule-based adaptive system using thermal sensors was deployed in Dnipro, Ukraine, establishing a real-world performance baseline with a 20–38 % delay reduction over fixed-time plans. Subsequently, a novel multi-agent RL (MARL) framework, Dynamic, Cost-Aware MARL (DCA-MARL), was developed and calibrated against this field data. The framework’s core innovations include a dynamic, multi-objective reward function that balances traffic efficiency with emissions, and a hard-coded Safety Constraint Layer (SCL) to ensure 100 % compliance with operational mandates. High-fidelity microscopic simulations demonstrate that DCA-MARL significantly outperforms fixed-time, the real-world actuated baseline, and standard RL models, achieving substantial reductions in delay while simultaneously and dramatically cutting fuel consumption and CO 2 emissions, all while maintaining zero safety violations.

Authors

Institutions

Publication Details

Journal
Results in Engineering
Published
2025-12-10
DOI
https://doi.org/10.1016/j.rineng.2025.108601
Primary Topic
Traffic control and management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive traffic signal optimization with thermal sensors and reinforcement learning

Elena Ponomaryova, Yuliia Balashova, Oleksandr Tregub, Andrii Balashov
Results in Engineering
Traffic control and management
article

Adaptive traffic signal optimization with thermal sensors and reinforcement learning

Elena Ponomaryova, Yuliia Balashova, Oleksandr Tregub, Andrii Balashov
article en

Abstract

• Real-world adaptive traffic signals with thermal sensors cut vehicle delays significantly • A new learning control system adjusts timing using traffic and environmental conditions • Safety guard rules ensure every signal change follows required road rules at all times • The learning system reduces fuel use and carbon emissions while improving travel times • Uses field data to build a realistic model that prepares the system for city deployment Static traffic signals remain a primary source of urban congestion, increasing vehicle delays and environmental impact. While reinforcement learning (RL) offers a promising solution, existing models often fail to address the multi-objective nature of traffic management, specifically by overlooking environmental costs and neglecting the operational safety guarantees required for real-world deployment. This study addresses this gap by introducing a novel, safety-first adaptive control framework, validated through a two-stage methodology. Initially, a rule-based adaptive system using thermal sensors was deployed in Dnipro, Ukraine, establishing a real-world performance baseline with a 20–38 % delay reduction over fixed-time plans. Subsequently, a novel multi-agent RL (MARL) framework, Dynamic, Cost-Aware MARL (DCA-MARL), was developed and calibrated against this field data. The framework’s core innovations include a dynamic, multi-objective reward function that balances traffic efficiency with emissions, and a hard-coded Safety Constraint Layer (SCL) to ensure 100 % compliance with operational mandates. High-fidelity microscopic simulations demonstrate that DCA-MARL significantly outperforms fixed-time, the real-world actuated baseline, and standard RL models, achieving substantial reductions in delay while simultaneously and dramatically cutting fuel consumption and CO 2 emissions, all while maintaining zero safety violations.

Results in EngineeringVol. 29
Prydniprovs’ka State Academy of Civil Engineering and Architecture (UA)
Openalex Percentile: Top 51%
Traffic control and management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.