X-Ray-Based Three-Dimensional Shape Reconstruction Method for a Continuum Manipulator
The utilization of visual sensors for three-dimensional (3D) reconstruction of continuum manipulators is a well-established technique, offering essential support for precise control and accurate state estimation. This approach has been widely adopted across various fields, including surgical robotics, bionic systems, and industrial automation. However, the effectiveness of visual sensors is substantially constrained in environments characterized by occlusions or spatial limitations, where accurate reconstruction becomes challenging. To overcome these limitations, we propose an advanced 3D reconstruction method leveraging X-ray imaging, enabling robust shape reconstruction and automated tracking of continuum manipulators, even under occluded conditions. In the X-ray-based 3D shape reconstruction method, the intrinsic and extrinsic parameters of the computed tomography (CT) device are calibrated. Besides, the X-ray images are processed with identification and segmentation, centerline detection and Bézier curve fitting. Finally, the 3D shapes of a continuum manipulator are accomplished by matching the two images acquired from two distinct CT device rotation angles and reconstruction. The measurement experiment has demonstrated the accuracy of 3D shape reconstruction achieved 0.5383 mm. The shape reconstruction experimental results also showed the effectiveness of the X-ray-based 3D shape reconstruction method.
Authors
- Huayu Zhang (ORCID: https://orcid.org/0009-0001-3130-5208)
- Xiaoyin Zheng (ORCID: https://orcid.org/0009-0005-9640-0563)
- Weibing Li (ORCID: https://orcid.org/0000-0002-7970-9076)
- Xin Ma (ORCID: https://orcid.org/0000-0002-9325-6384)
- Puchen Zhu (ORCID: https://orcid.org/0000-0003-3446-4535)
- Wenkai Lai
Institutions
- Sun Yat-sen University (CN)
- Chinese University of Hong Kong (HK)
Publication Details
- Published
- 2024-11-29
- DOI
- https://doi.org/10.1109/irac63143.2024.10871667
- Citations
- 1
- Primary Topic
- Image and Object Detection Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.25
Funders
- National Natural Science Foundation of China
- Chinese University of Hong Kong
- Shun Hing Institute of Advanced Engineering