Adaptive traffic signal optimization with thermal sensors and reinforcement learning
• Real-world adaptive traffic signals with thermal sensors cut vehicle delays significantly • A new learning control system adjusts timing using traffic and environmental conditions • Safety guard rules ensure every signal change follows required road rules at all times • The learning system reduces fuel use and carbon emissions while improving travel times • Uses field data to build a realistic model that prepares the system for city deployment Static traffic signals remain a primary source of urban congestion, increasing vehicle delays and environmental impact. While reinforcement learning (RL) offers a promising solution, existing models often fail to address the multi-objective nature of traffic management, specifically by overlooking environmental costs and neglecting the operational safety guarantees required for real-world deployment. This study addresses this gap by introducing a novel, safety-first adaptive control framework, validated through a two-stage methodology. Initially, a rule-based adaptive system using thermal sensors was deployed in Dnipro, Ukraine, establishing a real-world performance baseline with a 20–38 % delay reduction over fixed-time plans. Subsequently, a novel multi-agent RL (MARL) framework, Dynamic, Cost-Aware MARL (DCA-MARL), was developed and calibrated against this field data. The framework’s core innovations include a dynamic, multi-objective reward function that balances traffic efficiency with emissions, and a hard-coded Safety Constraint Layer (SCL) to ensure 100 % compliance with operational mandates. High-fidelity microscopic simulations demonstrate that DCA-MARL significantly outperforms fixed-time, the real-world actuated baseline, and standard RL models, achieving substantial reductions in delay while simultaneously and dramatically cutting fuel consumption and CO 2 emissions, all while maintaining zero safety violations.
Authors
- Elena Ponomaryova (ORCID: https://orcid.org/0000-0003-1254-4403)
- Yuliia Balashova (ORCID: https://orcid.org/0000-0002-2286-9263)
- Oleksandr Tregub (ORCID: https://orcid.org/0000-0001-6436-352X)
- Andrii Balashov (ORCID: https://orcid.org/0009-0007-5833-0888)
Institutions
- Prydniprovs’ka State Academy of Civil Engineering and Architecture (UA)
Publication Details
- Journal
- Results in Engineering
- Published
- 2025-12-10
- DOI
- https://doi.org/10.1016/j.rineng.2025.108601
- Primary Topic
- Traffic control and management
- Type
- article
- Field-Weighted Citation Impact
- 0.00