Integrating Visual Reasoning Localization with Reinforcement Learning for 3C Assembly

In 3C (Computer, Communication, and Consumer Electronics) flexible assembly tasks, due to the frequent updates and the increasing demand for intelligence, traditional automated assembly methods struggle to meet the requirements for high precision and adaptability. To address these challenges, this paper proposes an assembly method that combines visual reasoning localization with deep reinforcement learning. The method improves the reward function by integrating visual reasoning results with reinforcement learning and trains the model in a virtual environment. Through sim-to-real transfer, the assembly strategies learned in the virtual environment are applied to real-world scenarios, significantly enhancing the assembly accuracy and success rate in real-world settings. Validation on a 3C front camera assembly task demonstrates an assembly accuracy of 0.15 mm and a success rate of 97%.

Authors

Institutions

Publication Details

Published
2024-12-10
DOI
https://doi.org/10.1109/robio64047.2024.10907286
Citations
1
Primary Topic
Manufacturing Process and Optimization
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Visual Reasoning Localization with Reinforcement Learning for 3C Assembly

Baolin Huang, Fuchun Sun, Guo Jiahui, Jiaqi Zhang et al.
1 citations
Manufacturing Process and Optimization
0.35
article

Integrating Visual Reasoning Localization with Reinforcement Learning for 3C Assembly

Baolin Huang, Fuchun Sun, Guo Jiahui, Jiaqi Zhang, Huaidong Zhou
article en
1 citations

Abstract

In 3C (Computer, Communication, and Consumer Electronics) flexible assembly tasks, due to the frequent updates and the increasing demand for intelligence, traditional automated assembly methods struggle to meet the requirements for high precision and adaptability. To address these challenges, this paper proposes an assembly method that combines visual reasoning localization with deep reinforcement learning. The method improves the reward function by integrating visual reasoning results with reinforcement learning and trains the model in a virtual environment. Through sim-to-real transfer, the assembly strategies learned in the virtual environment are applied to real-world scenarios, significantly enhancing the assembly accuracy and success rate in real-world settings. Validation on a 3C front camera assembly task demonstrates an assembly accuracy of 0.15 mm and a success rate of 97%.

Northwestern Polytechnical University (CN), Beijing Information Science & Technology University (CN), Tsinghua University (CN)
Openalex Percentile: Top 31%
Manufacturing Process and Optimization
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Integrating Visual Reasoning Localization with Reinforcement Learning for 3C Assembly — Baolin Huang, Fuchun Sun, et al. · (2024) | TGRS Research Map | TGRS