Rearranging Deformable Linear Objects for Implicit Goals with Self‐Supervised Planning and Control
The robotic manipulation of deformable linear objects is a frontier problem with many potential applications in diverse industries. However, most existing research in this area focuses on shape control for a provided explicit goal and does not consider physical constraints, which limits its applicability in many real‐world scenarios. In this study, a self‐supervised planning and control approach are proposed to address the challenge of rearranging deformable linear objects for implicit goals. Specifically, the context of making both ends of the object reachable (inside the robotic access range) and graspable (outside potential collision regions) by dual‐arm robots is considered. Firstly, the object is described with sequential keypoints and the correspondence‐based action is parameterized. Secondly, a generator capable of producing multiple explicit targets is developed, which adhere to implicit conditions. Thirdly, value models are learnt to assign the most promising explicit target as guidance and determine the goal‐conditioned action. All models within the policy are trained in a self‐supervised manner based on data collected from simulations. Importantly, the learned policy can be directly applied to real‐world settings since we do not rely on accurate dynamic models. The performance of the new method is validated with simulations and real‐world experiments.
Authors
- Feiyu Hu (ORCID: https://orcid.org/0000-0002-1800-9826)
- Shengzeng Huo (ORCID: https://orcid.org/0000-0002-7652-8958)
- Jihong Zhu (ORCID: https://orcid.org/0000-0001-8185-5497)
- David Navarro-Alarcón (ORCID: https://orcid.org/0000-0002-3426-6638)
- Peng Zhou (ORCID: https://orcid.org/0000-0002-7020-0943)
- Luyin Hu (ORCID: https://orcid.org/0000-0002-2931-8552)
- Hesheng Wang (ORCID: https://orcid.org/0000-0003-2313-1823)
- Fangyuan Wang
Institutions
- Hong Kong Polytechnic University (HK)
- Shanghai Jiao Tong University (CN)
- Hong Kong University of Science and Technology (HK)
- Tencent (China) (CN)
- École Polytechnique Fédérale de Lausanne (CH)
- University of York (GB)
- University of Hong Kong (HK)
Publication Details
- Journal
- Advanced Intelligent Systems
- Published
- 2024-10-31
- DOI
- https://doi.org/10.1002/aisy.202400330
- Citations
- 2
- Primary Topic
- Manufacturing Process and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.70
Funders
- Hong Kong Polytechnic University