GauComp: 3D Gaussian Completion for Associated Shadow and Object Removal

Abstract Recent advancements in scene editing based on 3D Gaussian splatting techniques have achieved significant progress. However, existing scene editing methods still face critical limitations. One notable drawback is the inability to achieve cascading effect propagation—i.e., the automatic and consistent updating of associated elements such as shadows in response to object manipulations. Furthermore, most current methods perform object editing directly on 2D images, leading to inconsistencies across inputs from multiple viewpoints. In this paper, we present a novel pipeline named GauComp, focusing on address the task of object removal in 3D Gaussian‐based scenes, with automatic removal of associated shadows. The proposed method comprises three core stages: Shadow‐aware 3D Segmentation, Gaussian Completion, and Gaussian Refine. The Shadow‐aware 3D Segmentation stage establishes bidirectional associations between objects and shadows, enabling robust 3D scene segmentation by integrating 3D semantic modelling with instance‐level shadow detection. The Gaussian Completion stage leverages Normal‐aware PatchMatch to search for similar gaussian primitives from the same scene for 3D Gaussian completion to ensure geometric consistency during scene editing. Finally, the Gaussian Refine stage improves the quality of scene restoration by constraining the Gaussian optimization process, effectively suppressing errors such as false cloning and incorrect splitting. Experimental results demonstrate that GauComp significantly enhances restoration quality, completing scene editing and restoration within 54 seconds, thereby providing an efficient and high‐fidelity solution for 3D scene editing and restoration.