AI-Powered Retrofitting for Smart Reverse Engineering: An Approach of NeRF-Based Multi-object Recognition in Complex Ambience with Noise
In the context of smart reverse engineering and robotic warehousing, efficient and accurate 3D model generation remains a persistent challenge, especially in cluttered and noisy environments. This paper presents an AI-powered retrofitting framework that reconstructs 3D digital twins from monocular video using Neural Radiance Fields (NeRF), offering a cost-effective alternative to traditional hardware-intensive 3D scanning. The proposed pipeline integrates NeRF-based volumetric reconstruction with HSV-based background filtering, DBSCAN clustering, and KD-tree-based spatial recovery to recognize multiple objects from complex, real-world scenes. Demonstrated through an automotive case study, this approach enables component-level recognition and digital modeling without the need for physical tags or high-end scanners. The resulting point clouds are compact, pose-consistent, and directly applicable to downstream tasks such as CAD alignment and robotic manipulation. By addressing key limitations of conventional reverse engineering methods, this work offers a robust and scalable solution for 3D modeling under real-world industrial constraints.
Authors
- Hong-In Won
- Young-Ouk Kim
- Jianxin Jiao (ORCID: https://orcid.org/0000-0002-9832-7276)
- Dongin Shin
- Chenxi Tao
- Seung-Kyum Choi
Publication Details
- Published
- 2025-06-17
- DOI
- https://doi.org/10.46254/na10.20250319
- Primary Topic
- Industrial Vision Systems and Defect Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Trade, Industry and Energy
- Korea Institute for Advancement of Technology
- Korea Institute of Industrial Technology