Prevention of Unexpected Object Generation in Diffusion Model-Based Inpainting

In this paper, we propose a novel method to address “stamp artifacts”, a phenomenon in which unexpected objects are generated in diffusion model-based inpainting methods. A stamp artifact occurs when the region of an object to be removed is filled with a different object, resulting in unintended consequences. To solve this problem, we propose guiding diffusion model-based inpainting by incorporating results from traditional inpainting methods that use local information in the image. Experimental results showed that the proposed method effectively suppressed the appearance of unintended objects and achieved natural image completion.