Path Planning for Multi-AGV Systems Based on Globally Guided Reinforcement Learning Approach

The path planning for multi-AGV systems is particularly challenging in dynamic environments, where the AGVs must effectively reach their target locations while avoiding collisions with dynamic obstacles and other AGVs. Traditional approaches often rely on a re-planning strategy, triggering the planning algorithm whenever an AGV encounters a conflict. However, this method frequently results in unnecessary detours and deadlock issues. To overcome these challenges, this paper introduces a hierarchical reinforcement learning-based approach to multi-AG V path planning. This method establishes a globally guided reinforcement learning framework (G2-rMAPPO) by integrating global guided paths with the rMAPPO algorithm. Initially, a global path planner is employed to derive an optimal guided path for resolving static conflicts, while a rMAPPO-based local reinforcement learning planner is utilized to navigate dynamic conflicts. Additionally, a dense reward function is designed to effectively address the multi-AGV path planning problem. The feasibility and effectiveness of this approach are validated through experimental simulations.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/icus61736.2024.10839994
Citations
4
Primary Topic
Advanced Manufacturing and Logistics Optimization
Type
article
Field-Weighted Citation Impact
1.40

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Path Planning for Multi-AGV Systems Based on Globally Guided Reinforcement Learning Approach

Haibo Du, Lanlin Yu, Yusheng Wang, Zhu Sheng et al.
4 citations
Advanced Manufacturing and Logistics Optimization
1.40
article

Path Planning for Multi-AGV Systems Based on Globally Guided Reinforcement Learning Approach

Haibo Du, Lanlin Yu, Yusheng Wang, Zhu Sheng, Zhiqiang He, Pengfei Xu
article en
4 citations

Abstract

The path planning for multi-AGV systems is particularly challenging in dynamic environments, where the AGVs must effectively reach their target locations while avoiding collisions with dynamic obstacles and other AGVs. Traditional approaches often rely on a re-planning strategy, triggering the planning algorithm whenever an AGV encounters a conflict. However, this method frequently results in unnecessary detours and deadlock issues. To overcome these challenges, this paper introduces a hierarchical reinforcement learning-based approach to multi-AG V path planning. This method establishes a globally guided reinforcement learning framework (G2-rMAPPO) by integrating global guided paths with the rMAPPO algorithm. Initially, a global path planner is employed to derive an optimal guided path for resolving static conflicts, while a rMAPPO-based local reinforcement learning planner is utilized to navigate dynamic conflicts. Additionally, a dense reward function is designed to effectively address the multi-AGV path planning problem. The feasibility and effectiveness of this approach are validated through experimental simulations.

Hefei University of Technology (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 15%
Advanced Manufacturing and Logistics Optimization
1.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Path Planning for Multi-AGV Systems Based on Globally Guided Reinforcement Learning Approach — Haibo Du, Lanlin Yu, et al. · (2024) | TGRS Research Map | TGRS