Images Inpainting via Region Convolution and Feature Fusion
Image inpainting aims to fill damaged regions with reasonable structure, fine texture details, and semantically consistent content. However, existing deep learning algorithms mostly employ standard convolution architecture on damaged images, resulting in meaningless content such as color differences, blurring, and other artifacts. Aiming at the problem that the standard convolution methods cannot fully exploit the known regions to predict the damaged region features, this paper proposes an efficient region convolution (ERC) module to distinguish between known and damaged regions, and effectively prevent interference from invalid pixels through feature migration, additionally, the sampling regions are dynamically expanded to reconstruct the damaged regions more accurately. This article proposes a novel inpainting network that utilizes an encoder-decoder framework to restore images that are both semantically reasonable and visually realistic. Extensive experiments on two public datasets, Paris StreetView and CelebA, both qualitatively and quantitatively prove the strengths of the proposed approach.
Authors
- Bin Zhou
- Zhisheng Gao (ORCID: https://orcid.org/0000-0002-0470-8861)
- Jinrong Li (ORCID: https://orcid.org/0009-0009-4173-7918)
Institutions
- Xihua University (CN)
Publication Details
- Published
- 2024-09-13
- DOI
- https://doi.org/10.1145/3700906.3700935
- Primary Topic
- Generative Adversarial Networks and Image Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00