Autonomous Navigation and Collision Avoidance for AGV in Dynamic Environments: An Enhanced Deep Reinforcement Learning Approach With Composite Rewards and Dynamic Update Mechanisms
ABSTRACT With the booming development of logistics, manufacturing and warehousing fields, the autonomous navigation and intelligent obstacle avoidance technology of automated guided vehicles (AGVs) has become the focus of scientific research. In this paper, an enhanced deep reinforcement learning (DRL) framework is proposed, aiming to empower AGVs with the ability of autonomous navigation and obstacle avoidance in the unknown and variable complex environment. To address the problems of time‐consuming training and limited generalisation ability of traditional DRL, we refine the twin delayed deep deterministic policy gradient algorithm by integrating adaptive noise attenuation and dynamic delayed updating, optimising both training efficiency and model robustness. In order to further strengthen the AGV's ability to perceive and respond to changes of a dynamic environment, we introduce a distance‐based obstacle penalty term in the designed composite reward function, which ensures that the AGV is capable of predicting and avoiding obstacles effectively in dynamic scenarios. Experiments indicate that the AGV model trained by this algorithm presents excellent autonomous navigation capability in both static and dynamic environments, with a high task completion rate, stable and reliable operation, which fully proves the high efficiency and robustness of this method and its practical value.
Authors
- Shengze Cai (ORCID: https://orcid.org/0000-0003-0122-6864)
- Tehuan Chen (ORCID: https://orcid.org/0000-0002-5370-4410)
- Chao Xu (ORCID: https://orcid.org/0000-0002-0873-7192)
- Zhifeng Huang (ORCID: https://orcid.org/0000-0003-0632-1027)
- Zhigang Ren (ORCID: https://orcid.org/0000-0002-0913-0130)
Institutions
- Ningbo University (CN)
- Guangdong University of Technology (CN)
- State Key Laboratory of Industrial Control Technology (CN)
- Zhejiang University of Technology (CN)
Publication Details
- Journal
- IET Cyber-Systems and Robotics
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1049/csy2.70012
- Primary Topic
- Advanced Manufacturing and Logistics Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China