DQN-Based Adaptive Intersection Control for Warehouse AGVs in SUMO with a Proposed VLC Architecture

Congestion at shared intersections can limit the scalability of Automated Guided Vehicle (AGV) fleets in high-density warehouses. This study evaluates a Deep Q-Network (DQN) controller for adaptive intersection management in a SUMO-based warehouse model with five crossings, including the shared central crossing CP1. After one 200-episode training run, the DQN was evaluated in three seeded 6200 s simulations per demand scenario. Against a study-specific cyclic fixed-time controller at 250, 350, and 400 AGVs/h, the DQN achieved unweighted mean reductions of 62.9% in signal queue, 59.1% in average waiting time, and 18.0% in AGVs waiting to load, while loading/unloading occupancy changed by less than 1%. A matched 750 AGVs/h stress test showed that the benefit did not persist after saturation: at CP1, the mean signal queue increased from 13.15 to 30.68 AGVs and the mean number waiting to load from 9.64 to 15.93 AGVs. Sustained CP1 congestion began between 350 and 400 AGVs/h for the tested layout. Retained test outputs quantify test-level dispersion, but the single training run cannot estimate training variability. These results quantify the DQN traffic-control policy under ideal availability of SUMO state information and do not validate a VLC system. VLC is presented separately as a proposed future implementation layer; communication delay, packet loss, occlusion, and other physical-channel effects were not modelled.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-09-30
DOI
https://doi.org/10.3390/s26196212
Primary Topic
Traffic control and management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

DQN-Based Adaptive Intersection Control for Warehouse AGVs in SUMO with a Proposed VLC Architecture

Gonçalo Galvão, Manuela Vieira, Paula A. Louro, Manuel Augusto Vieira et al.
Sensors
Traffic control and management
article

DQN-Based Adaptive Intersection Control for Warehouse AGVs in SUMO with a Proposed VLC Architecture

Gonçalo Galvão, Manuela Vieira, Paula A. Louro, Manuel Augusto Vieira, Susana Amaral
article en

Abstract

Congestion at shared intersections can limit the scalability of Automated Guided Vehicle (AGV) fleets in high-density warehouses. This study evaluates a Deep Q-Network (DQN) controller for adaptive intersection management in a SUMO-based warehouse model with five crossings, including the shared central crossing CP1. After one 200-episode training run, the DQN was evaluated in three seeded 6200 s simulations per demand scenario. Against a study-specific cyclic fixed-time controller at 250, 350, and 400 AGVs/h, the DQN achieved unweighted mean reductions of 62.9% in signal queue, 59.1% in average waiting time, and 18.0% in AGVs waiting to load, while loading/unloading occupancy changed by less than 1%. A matched 750 AGVs/h stress test showed that the benefit did not persist after saturation: at CP1, the mean signal queue increased from 13.15 to 30.68 AGVs and the mean number waiting to load from 9.64 to 15.93 AGVs. Sustained CP1 congestion began between 350 and 400 AGVs/h for the tested layout. Retained test outputs quantify test-level dispersion, but the single training run cannot estimate training variability. These results quantify the DQN traffic-control policy under ideal availability of SUMO state information and do not validate a VLC system. VLC is presented separately as a proposed future implementation layer; communication delay, packet loss, occlusion, and other physical-channel effects were not modelled.

SensorsVol. 26(19)
Instituto Politécnico de Lisboa (PT), Universidade Nova de Lisboa (PT)
Openalex Percentile: Top 16%
Traffic control and management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.