MGP-KAD: Multimodal Geometric Priors and Kolmogorov-Arnold Decoder for Single-View 3d Reconstruction in Complex Scenes
Single-view 3D reconstruction in complex real-world scenes is challenging due to noise, object diversity, and limited dataset availability. To address these challenges, we propose MGP-KAD, a novel multimodal feature fusion framework that integrates RGB and geometric prior to enhance reconstruction accuracy. The geometric prior is generated by sampling and clustering ground-truth object data, producing class-level features that dynamically adjust during training to improve geometric understanding. Additionally, we introduce a hybrid decoder based on Kolmogorov-Arnold Networks (KAN) to overcome the limitations of traditional linear decoders in processing complex multimodal inputs. Extensive experiments on the Pix3D dataset demonstrate that MGP-KAD achieves state-of-the-art (SOTA) performance, significantly improving geometric integrity, smoothness, and detail preservation. Our work provides a robust and effective solution for advancing single-view 3D reconstruction in complex scenes.
Authors
- Itaru Kitahara (ORCID: https://orcid.org/0000-0002-5186-789X)
- Chun Xie (ORCID: https://orcid.org/0000-0003-0425-4166)
- Li Zhang (ORCID: https://orcid.org/0000-0003-1126-3300)
Institutions
- Computational Physics (United States) (US)
- Empowerment Program (US)
Publication Details
- Published
- 2025-08-18
- DOI
- https://doi.org/10.1109/icip55913.2025.11083973
- Citations
- 1
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 1.33