Human-in-the-Loop Gaussian Model Enhancement with Mobile Robotic Re-Capture
3D Gaussian Splatting can create virtual models with captured real-world images using a camera mounted on a mobile robotic arm. However, the Gaussian model quality deteriorates when parts of the object that have not been previously captured are exposed in VR interaction. This poster presents a human-in-the-loop Gaussian model enhancement method, comprising pre-training, viewpoint labeling, robotic image re-capture, and Gaussian model enhancement. By incorporating newly re-captured images, the enhanced models achieve improved image similarity metrics compared to the pre-trained ones, with minimal optimization time. This method facilitates continuous quality improvement, making Gaussian models more adaptable for VR applications.
Authors
- Yihua Bao (ORCID: https://orcid.org/0000-0002-4250-2258)
- Xiaonuo Dongye (ORCID: https://orcid.org/0000-0002-9521-3302)
- Hanzhi Guo
- Dongdong Weng (ORCID: https://orcid.org/0000-0003-2352-0896)
- Haiyan Jiang (ORCID: https://orcid.org/0000-0002-6796-2568)
Institutions
- Beijing Institute of Technology (CN)
- Singapore Institute of Technology (SG)
Publication Details
- Published
- 2025-03-08
- DOI
- https://doi.org/10.1109/vrw66409.2025.00314
- Citations
- 1
- Primary Topic
- Autonomous Vehicle Technology and Safety
- Type
- article
- Field-Weighted Citation Impact
- 0.68