Integrating Visual Reasoning Localization with Reinforcement Learning for 3C Assembly
In 3C (Computer, Communication, and Consumer Electronics) flexible assembly tasks, due to the frequent updates and the increasing demand for intelligence, traditional automated assembly methods struggle to meet the requirements for high precision and adaptability. To address these challenges, this paper proposes an assembly method that combines visual reasoning localization with deep reinforcement learning. The method improves the reward function by integrating visual reasoning results with reinforcement learning and trains the model in a virtual environment. Through sim-to-real transfer, the assembly strategies learned in the virtual environment are applied to real-world scenarios, significantly enhancing the assembly accuracy and success rate in real-world settings. Validation on a 3C front camera assembly task demonstrates an assembly accuracy of 0.15 mm and a success rate of 97%.
Authors
- Baolin Huang (ORCID: https://orcid.org/0000-0002-3342-5545)
- Fuchun Sun (ORCID: https://orcid.org/0000-0003-3546-6305)
- Guo Jiahui (ORCID: https://orcid.org/0000-0002-1528-9025)
- Jiaqi Zhang (ORCID: https://orcid.org/0000-0002-1649-3378)
- Huaidong Zhou
Institutions
- Northwestern Polytechnical University (CN)
- Beijing Information Science & Technology University (CN)
- Tsinghua University (CN)
Publication Details
- Published
- 2024-12-10
- DOI
- https://doi.org/10.1109/robio64047.2024.10907286
- Citations
- 1
- Primary Topic
- Manufacturing Process and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.35