Autonomous Navigation and Collision Avoidance for AGV in Dynamic Environments: An Enhanced Deep Reinforcement Learning Approach With Composite Rewards and Dynamic Update Mechanisms

ABSTRACT With the booming development of logistics, manufacturing and warehousing fields, the autonomous navigation and intelligent obstacle avoidance technology of automated guided vehicles (AGVs) has become the focus of scientific research. In this paper, an enhanced deep reinforcement learning (DRL) framework is proposed, aiming to empower AGVs with the ability of autonomous navigation and obstacle avoidance in the unknown and variable complex environment. To address the problems of time‐consuming training and limited generalisation ability of traditional DRL, we refine the twin delayed deep deterministic policy gradient algorithm by integrating adaptive noise attenuation and dynamic delayed updating, optimising both training efficiency and model robustness. In order to further strengthen the AGV's ability to perceive and respond to changes of a dynamic environment, we introduce a distance‐based obstacle penalty term in the designed composite reward function, which ensures that the AGV is capable of predicting and avoiding obstacles effectively in dynamic scenarios. Experiments indicate that the AGV model trained by this algorithm presents excellent autonomous navigation capability in both static and dynamic environments, with a high task completion rate, stable and reliable operation, which fully proves the high efficiency and robustness of this method and its practical value.

Authors

Institutions

Publication Details

Journal
IET Cyber-Systems and Robotics
Published
2025-01-01
DOI
https://doi.org/10.1049/csy2.70012
Primary Topic
Advanced Manufacturing and Logistics Optimization
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Autonomous Navigation and Collision Avoidance for AGV in Dynamic Environments: An Enhanced Deep Reinforcement Learning Approach With Composite Rewards and Dynamic Update Mechanisms

Shengze Cai, Tehuan Chen, Chao Xu, Zhifeng Huang et al.
IET Cyber-Systems and Robotics
Advanced Manufacturing and Logistics Optimization
article

Autonomous Navigation and Collision Avoidance for AGV in Dynamic Environments: An Enhanced Deep Reinforcement Learning Approach With Composite Rewards and Dynamic Update Mechanisms

Shengze Cai, Tehuan Chen, Chao Xu, Zhifeng Huang, Zhigang Ren
article en

Abstract

ABSTRACT With the booming development of logistics, manufacturing and warehousing fields, the autonomous navigation and intelligent obstacle avoidance technology of automated guided vehicles (AGVs) has become the focus of scientific research. In this paper, an enhanced deep reinforcement learning (DRL) framework is proposed, aiming to empower AGVs with the ability of autonomous navigation and obstacle avoidance in the unknown and variable complex environment. To address the problems of time‐consuming training and limited generalisation ability of traditional DRL, we refine the twin delayed deep deterministic policy gradient algorithm by integrating adaptive noise attenuation and dynamic delayed updating, optimising both training efficiency and model robustness. In order to further strengthen the AGV's ability to perceive and respond to changes of a dynamic environment, we introduce a distance‐based obstacle penalty term in the designed composite reward function, which ensures that the AGV is capable of predicting and avoiding obstacles effectively in dynamic scenarios. Experiments indicate that the AGV model trained by this algorithm presents excellent autonomous navigation capability in both static and dynamic environments, with a high task completion rate, stable and reliable operation, which fully proves the high efficiency and robustness of this method and its practical value.

IET Cyber-Systems and RoboticsVol. 7(1)
Ningbo University (CN), Guangdong University of Technology (CN), State Key Laboratory of Industrial Control Technology (CN), Zhejiang University of Technology (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 91%
Advanced Manufacturing and Logistics Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.