A Node-Based Nash-Inspired D3QN RL Framework for Traffic–Energy Coordinated AGV Scheduling in Smart Warehouses

Automated guided vehicle (AGV) scheduling in large warehouses becomes increasingly difficult as dense traffic and concentrated charging demands interact at shared intersections. Vehicle-centric multi-agent reinforcement learning (MARL) also faces increasing state dimensionality and non-stationarity as the fleet grows. This study therefore models controlled road-network nodes, rather than individual AGVs, as agents and develops a Nash-D3QN framework for traffic–energy coordinated scheduling. A* generates initial feasible paths, Nash-D3QN allocates intersection right-of-way using local and neighboring states, and a shared Petri-net layer enforces occupancy and safety constraints. State of charge (SOC), payload, start–stop losses, and charging queues are incorporated into the state, action, and reward designs to favor low-SOC and heavily loaded AGVs when necessary. In the 50-AGV scenario, Nash-D3QN shows numerically higher task completion rates than the compared baselines by 0.41–1.40 percentage points, together with 7.6–24.0% lower average waiting time, 4.7–46.0% higher SOC efficiency, and 8.38–32.42 percentage points higher coordination rates. Multi-seed analysis further evaluates task completion, coordination, SOC-based task efficiency, and waiting time at 50, 110, and 200 AGVs. With 200 AGVs, Nash-D3QN retains approximately 76.34% task completion, 2.68 tasks/SOC efficiency, and 86.17% coordination, indicating performance retention under larger tested system scales and operating loads.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-10-29
DOI
https://doi.org/10.3390/app162110725
Primary Topic
Advanced Manufacturing and Logistics Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Node-Based Nash-Inspired D3QN RL Framework for Traffic–Energy Coordinated AGV Scheduling in Smart Warehouses

Bin Sun, Yusun Zhou, Mohan Shu
5 links
Applied Sciences
Advanced Manufacturing and Logistics Optimization
article

A Node-Based Nash-Inspired D3QN RL Framework for Traffic–Energy Coordinated AGV Scheduling in Smart Warehouses

Bin Sun, Yusun Zhou, Mohan Shu
article en

Abstract

Automated guided vehicle (AGV) scheduling in large warehouses becomes increasingly difficult as dense traffic and concentrated charging demands interact at shared intersections. Vehicle-centric multi-agent reinforcement learning (MARL) also faces increasing state dimensionality and non-stationarity as the fleet grows. This study therefore models controlled road-network nodes, rather than individual AGVs, as agents and develops a Nash-D3QN framework for traffic–energy coordinated scheduling. A* generates initial feasible paths, Nash-D3QN allocates intersection right-of-way using local and neighboring states, and a shared Petri-net layer enforces occupancy and safety constraints. State of charge (SOC), payload, start–stop losses, and charging queues are incorporated into the state, action, and reward designs to favor low-SOC and heavily loaded AGVs when necessary. In the 50-AGV scenario, Nash-D3QN shows numerically higher task completion rates than the compared baselines by 0.41–1.40 percentage points, together with 7.6–24.0% lower average waiting time, 4.7–46.0% higher SOC efficiency, and 8.38–32.42 percentage points higher coordination rates. Multi-seed analysis further evaluates task completion, coordination, SOC-based task efficiency, and waiting time at 50, 110, and 200 AGVs. With 200 AGVs, Nash-D3QN retains approximately 76.34% task completion, 2.68 tasks/SOC efficiency, and 86.17% coordination, indicating performance retention under larger tested system scales and operating loads.

Applied SciencesVol. 16(21)
Hangzhou City University (CN), Zhejiang University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 13%
Advanced Manufacturing and Logistics Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon