A Cable‐Actuated Soft Manipulator for Dexterous Grasping Based on Deep Reinforcement Learning
The growing interest in the flexibility and operational capabilities of soft manipulators in confined spaces emphasizes the need for precise modeling and accurate motion control. Conventional control methods encounter difficulties in modeling and involve intricate computations. This work introduces a novel deep reinforcement learning (DRL) control algorithm based on neural network modeling. Using the Whale Optimization Algorithm, an approximate dynamic model for the soft manipulator is established. The twin delayed deterministic policy gradient is employed for DRL control. Domain randomization is applied during pretraining in a simulated environment. The algorithm addresses issues related to dependency on measurement data quality and redundant mappings, outperforming other methods by 8–15 mm in control accuracy. The trained DRL controller achieves precise trajectory tracking within the soft manipulator's task space, enabling successful grasping tasks in various complex environments, including pipelines and other narrow spaces. Experimental results confirm the autonomy of our controller in performing these tasks without human intervention.
Authors
- Juntian Qu (ORCID: https://orcid.org/0000-0002-1799-5847)
- Yuzhu Zhang (ORCID: https://orcid.org/0009-0008-3848-7076)
- Yaozhen Chen (ORCID: https://orcid.org/0000-0003-2291-0622)
- Baijin Mao (ORCID: https://orcid.org/0009-0007-3133-1805)
- Hongwei Hao (ORCID: https://orcid.org/0000-0003-2019-516X)
- Zhenping Yu
- Houde Liu (ORCID: https://orcid.org/0000-0002-7314-3366)
- Xueqian Wang (ORCID: https://orcid.org/0000-0002-8632-6073)
- Yanwen Li (ORCID: https://orcid.org/0000-0003-3221-0945)
- Yuyaocen Xiang
- Wei Tang (ORCID: https://orcid.org/0000-0003-3091-0374)
- Kunyu Zhou
- Xiaohao Wang
Institutions
- University Town of Shenzhen (CN)
- ETH Zurich (CH)
- Tsinghua University (CN)
Publication Details
- Journal
- Advanced Intelligent Systems
- Published
- 2024-08-29
- DOI
- https://doi.org/10.1002/aisy.202400112
- Citations
- 8
- Primary Topic
- Soft Robotics and Applications
- Type
- article
- Field-Weighted Citation Impact
- 1.48
Funders
- National Natural Science Foundation of China
- Shenzhen Peacock Plan
- Shenzhen Science and Technology Innovation Program