A Cable‐Actuated Soft Manipulator for Dexterous Grasping Based on Deep Reinforcement Learning

The growing interest in the flexibility and operational capabilities of soft manipulators in confined spaces emphasizes the need for precise modeling and accurate motion control. Conventional control methods encounter difficulties in modeling and involve intricate computations. This work introduces a novel deep reinforcement learning (DRL) control algorithm based on neural network modeling. Using the Whale Optimization Algorithm, an approximate dynamic model for the soft manipulator is established. The twin delayed deterministic policy gradient is employed for DRL control. Domain randomization is applied during pretraining in a simulated environment. The algorithm addresses issues related to dependency on measurement data quality and redundant mappings, outperforming other methods by 8–15 mm in control accuracy. The trained DRL controller achieves precise trajectory tracking within the soft manipulator's task space, enabling successful grasping tasks in various complex environments, including pipelines and other narrow spaces. Experimental results confirm the autonomy of our controller in performing these tasks without human intervention.

Authors

Institutions

Publication Details

Journal
Advanced Intelligent Systems
Published
2024-08-29
DOI
https://doi.org/10.1002/aisy.202400112
Citations
8
Primary Topic
Soft Robotics and Applications
Type
article
Field-Weighted Citation Impact
1.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Cable‐Actuated Soft Manipulator for Dexterous Grasping Based on Deep Reinforcement Learning

Juntian Qu, Yuzhu Zhang, Yaozhen Chen, Baijin Mao et al.
8 citations
Advanced Intelligent Systems
Soft Robotics and Applications
1.48
article

A Cable‐Actuated Soft Manipulator for Dexterous Grasping Based on Deep Reinforcement Learning

Juntian Qu, Yuzhu Zhang, Yaozhen Chen, Baijin Mao, Hongwei Hao, Zhenping Yu, Houde Liu, Xueqian Wang, Yanwen Li, Yuyaocen Xiang, Wei Tang, Kunyu Zhou, Xiaohao Wang
article en
8 citations

Abstract

The growing interest in the flexibility and operational capabilities of soft manipulators in confined spaces emphasizes the need for precise modeling and accurate motion control. Conventional control methods encounter difficulties in modeling and involve intricate computations. This work introduces a novel deep reinforcement learning (DRL) control algorithm based on neural network modeling. Using the Whale Optimization Algorithm, an approximate dynamic model for the soft manipulator is established. The twin delayed deterministic policy gradient is employed for DRL control. Domain randomization is applied during pretraining in a simulated environment. The algorithm addresses issues related to dependency on measurement data quality and redundant mappings, outperforming other methods by 8–15 mm in control accuracy. The trained DRL controller achieves precise trajectory tracking within the soft manipulator's task space, enabling successful grasping tasks in various complex environments, including pipelines and other narrow spaces. Experimental results confirm the autonomy of our controller in performing these tasks without human intervention.

Advanced Intelligent SystemsVol. 6(10)
University Town of Shenzhen (CN), ETH Zurich (CH), Tsinghua University (CN)
National Natural Science Foundation of China, Shenzhen Peacock Plan, Shenzhen Science and Technology Innovation Program
Life below water
Openalex Percentile: Top 19%
Soft Robotics and Applications
1.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.