Research on Intelligent Grasping of Flexible Manipulator Combined with Visual Perception
This paper proposes an intelligent grasping system that integrates a deep learning-based visual perception method with a flexible manipulator control strategy. An improved YOLOv5 network and point cloud processing algorithm are used to achieve accurate detection and recognition of target objects. The system integrates RGB-D image data and object geometric information through an innovative adaptive feature fusion algorithm, and generates optimal grasping strategies via a deep reinforcement learning approach based on value iteration networks. This enables high-precision grasping of irregularly shaped, transparent, and reflective objects. Experiments conducted on 1,000 tests covering 50 different object categories demonstrate a grasping success rate of 93.857% under various lighting conditions and shape variations. Specifically, the success rates for irregular and transparent/reflective objects reached 90.125% and 87.652%, respectively, significantly outperforming existing methods. The system achieved a positional accuracy of 3.256 mm and a pose accuracy of 2.437°, representing improvements of 15.632% in grasping accuracy and 22.475% in execution efficiency compared to conventional approaches. Moreover, it exhibited excellent robustness under environmental disturbances, offering a practical technical solution for industrial automation production lines and service robotics applications.
Authors
- Jie Jin (ORCID: https://orcid.org/0000-0001-8055-5265)
- Yangjian Yang
- Meng Wang (ORCID: https://orcid.org/0000-0001-6665-5884)
- Yuanyuan Shao (ORCID: https://orcid.org/0000-0002-2399-4031)
- Bin Fu (ORCID: https://orcid.org/0000-0002-0035-9473)
Institutions
- Taizhou University (CN)
Publication Details
- Published
- 2025-06-06
- DOI
- https://doi.org/10.1109/raiie65740.2025.11139854
- Primary Topic
- Teleoperation and Haptic Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00