SS-Pose: Self-Supervised 6-D Object Pose Representation Learning Without Rendering
Object pose estimation has extensive applications in various industrial scenarios. However, the heavy reliance on dense 6-D annotation and textured object models has become a significant obstacle to the widespread industrial application of 6-D object pose estimation methods. In this work, we present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">SS-Pose</i>, a self-supervised learning framework for estimating 6-D object poses without annotated 6-D data and textured model. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">SS-Pose</i> proposes the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">coordinate system datum reinitializer</i> stage to dynamically establish a sequence-level pose representation datum, and the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">temporal–spatial constraint resolver</i> module to obtain the self-supervised learning target through interframe constraints. We introduce a one-shot <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">cross-coordinate transformation</i> that establishes the relationship between the 6-D representation and the object poses, which can be further utilized in real-world tasks. We evaluated the proposed <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">SS-Pose</i> on the challenging YCB-Video dataset and texture-less T-LESS dataset. Our approach achieves competitive performance with significantly lower data dependency, making it suitable for visual perception in industrial applications.
Authors
- Fengjun Mu (ORCID: https://orcid.org/0000-0002-6153-049X)
- Rui Huang (ORCID: https://orcid.org/0000-0001-7231-5042)
- Jing Qiu (ORCID: https://orcid.org/0000-0003-4393-4084)
- Hong Cheng (ORCID: https://orcid.org/0000-0001-5532-9530)
- Huayi Zhan
- Jingting Zhang (ORCID: https://orcid.org/0000-0002-5723-0822)
- Chaobin Zou (ORCID: https://orcid.org/0000-0003-3457-6369)
- Shixiang Sun (ORCID: https://orcid.org/0000-0003-0041-9058)
- Pengbo Zhao (ORCID: https://orcid.org/0000-0002-6780-5909)
- Kecheng Shi (ORCID: https://orcid.org/0000-0003-3448-9492)
Institutions
- University of Electronic Science and Technology of China (CN)
- Huawei Technologies (China) (CN)
- Changhong (China) (CN)
Publication Details
- Journal
- IEEE Transactions on Industrial Informatics
- Published
- 2024-09-10
- DOI
- https://doi.org/10.1109/tii.2024.3424591
- Citations
- 4
- Primary Topic
- Robot Manipulation and Learning
- Type
- article
- Field-Weighted Citation Impact
- 1.31
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Fundamental Research Funds for the Central Universities