Research on Reinforcement Learning Based Warehouse Robot Navigation Algorithm in Complex Warehouse Layout

This paper addresses the challenge of efficiently determining the optimal path in complex warehouse layouts while enabling real-time decision-making. We introduce a novel approach that combines Proximal Policy Optimization (PPO) with Dijkstra's algorithm, referred to as Proximal Policy-Dijkstra (PP-D). The PP-D method leverages PPO for effective strategy learning and real-time decision-making, while Dijkstra's algorithm is employed for global optimal path planning, ensuring high navigation accuracy and significantly enhancing path planning efficiency. Specifically, PPO allows robots to swiftly adapt and refine their action strategies in dynamic environments through its stable policy update mechanism, whereas Dijkstra's algorithm provides optimal path planning in static settings. Comparative experiments demonstrate that the PP-D framework outperforms traditional algorithms, particularly in navigation prediction accuracy and system robustness. Notably, in complex warehouse layouts, the PP-D method achieves more precise optimal path identification, minimizing collisions and stagnation. This underscores the reliability and effectiveness of our proposed navigation algorithm for robots in intricate warehouse environments.

Authors

Institutions

Publication Details

Published
2024-11-28
DOI
https://doi.org/10.1109/icaica63239.2024.10823054
Citations
27
Primary Topic
Advanced Manufacturing and Logistics Optimization
Type
article
Field-Weighted Citation Impact
9.42
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Reinforcement Learning Based Warehouse Robot Navigation Algorithm in Complex Warehouse Layout

Jiajing Chen, Li Zhao, Dezhi Yu, Xiaofan Zhou et al.
27 citations
Advanced Manufacturing and Logistics Optimization
9.42
article

Research on Reinforcement Learning Based Warehouse Robot Navigation Algorithm in Complex Warehouse Layout

Jiajing Chen, Li Zhao, Dezhi Yu, Xiaofan Zhou, Keqin Li, Ming Li, Congyu Wang, Lipeng Liu
article en
27 citations

Abstract

This paper addresses the challenge of efficiently determining the optimal path in complex warehouse layouts while enabling real-time decision-making. We introduce a novel approach that combines Proximal Policy Optimization (PPO) with Dijkstra's algorithm, referred to as Proximal Policy-Dijkstra (PP-D). The PP-D method leverages PPO for effective strategy learning and real-time decision-making, while Dijkstra's algorithm is employed for global optimal path planning, ensuring high navigation accuracy and significantly enhancing path planning efficiency. Specifically, PPO allows robots to swiftly adapt and refine their action strategies in dynamic environments through its stable policy update mechanism, whereas Dijkstra's algorithm provides optimal path planning in static settings. Comparative experiments demonstrate that the PP-D framework outperforms traditional algorithms, particularly in navigation prediction accuracy and system robustness. Notably, in complex warehouse layouts, the PP-D method achieves more precise optimal path identification, minimizing collisions and stagnation. This underscores the reliability and effectiveness of our proposed navigation algorithm for robots in intricate warehouse environments.

Georgia Institute of Technology (US), University of Illinois Urbana-Champaign (US), Trine University (US), Peking University (CN), University of Florida (US), AMA Computer University (PH), New York University (US), Seattle University (US), University of California, Berkeley (US)
Openalex Percentile: Top 2%
Advanced Manufacturing and Logistics Optimization
9.42
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.