ERF-FEM: The Feature Extraction Module based on Effective Receptive Field used for Image Inpainting
Many image inpainting models that rely on convolutional neural networks (CNN) have been extensively utilized in diverse image inpainting contexts, achieving outstanding results. Regrettably, due to the constraints of convolutional kernels, these approaches lack the capacity to capture multi-scale features. On the contrary, the majority of image inpainting methods regarded corrupted images as common pixel consistency images, disregarding the influence of the corrupted regions, such as shifts in mean and variance. To address the aforementioned challenges, we propose an image inpainting model that leverages a multi-scale feature extraction module and attention-enhanced learnable region normalization. It is capable of obtaining feature maps of different scales without stacking multiple layers of convolutions, alleviating the problems of detail information loss and low local computational efficiency. Additionally, during normalization, the learnable region normalization enhanced by attention can mitigate the offset effect of invalid pixels on mean and variance. Our method was verified on datasets Places2 and CelebA, and it was indicated by the experimental results that the similar methods currently accessible were outperformed by our method.
Authors
- Enhui Chai (ORCID: https://orcid.org/0000-0003-1298-4564)
- Shulin Zhao (ORCID: https://orcid.org/0000-0002-0696-3065)
- Xiaofeng Wang (ORCID: https://orcid.org/0009-0001-6453-1826)
- Chen Li (ORCID: https://orcid.org/0000-0001-6249-8957)
- Yahui Feng
Institutions
- Northwest University (CN)
Publication Details
- Published
- 2024-10-28
- DOI
- https://doi.org/10.1109/icsp62129.2024.10846304
- Primary Topic
- Image Processing and 3D Reconstruction
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Research and Development