ERF-FEM: The Feature Extraction Module based on Effective Receptive Field used for Image Inpainting

Many image inpainting models that rely on convolutional neural networks (CNN) have been extensively utilized in diverse image inpainting contexts, achieving outstanding results. Regrettably, due to the constraints of convolutional kernels, these approaches lack the capacity to capture multi-scale features. On the contrary, the majority of image inpainting methods regarded corrupted images as common pixel consistency images, disregarding the influence of the corrupted regions, such as shifts in mean and variance. To address the aforementioned challenges, we propose an image inpainting model that leverages a multi-scale feature extraction module and attention-enhanced learnable region normalization. It is capable of obtaining feature maps of different scales without stacking multiple layers of convolutions, alleviating the problems of detail information loss and low local computational efficiency. Additionally, during normalization, the learnable region normalization enhanced by attention can mitigate the offset effect of invalid pixels on mean and variance. Our method was verified on datasets Places2 and CelebA, and it was indicated by the experimental results that the similar methods currently accessible were outperformed by our method.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/icsp62129.2024.10846304
Primary Topic
Image Processing and 3D Reconstruction
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ERF-FEM: The Feature Extraction Module based on Effective Receptive Field used for Image Inpainting

Enhui Chai, Shulin Zhao, Xiaofeng Wang, Chen Li et al.
Image Processing and 3D Reconstruction
article

ERF-FEM: The Feature Extraction Module based on Effective Receptive Field used for Image Inpainting

Enhui Chai, Shulin Zhao, Xiaofeng Wang, Chen Li, Yahui Feng
article en

Abstract

Many image inpainting models that rely on convolutional neural networks (CNN) have been extensively utilized in diverse image inpainting contexts, achieving outstanding results. Regrettably, due to the constraints of convolutional kernels, these approaches lack the capacity to capture multi-scale features. On the contrary, the majority of image inpainting methods regarded corrupted images as common pixel consistency images, disregarding the influence of the corrupted regions, such as shifts in mean and variance. To address the aforementioned challenges, we propose an image inpainting model that leverages a multi-scale feature extraction module and attention-enhanced learnable region normalization. It is capable of obtaining feature maps of different scales without stacking multiple layers of convolutions, alleviating the problems of detail information loss and low local computational efficiency. Additionally, during normalization, the learnable region normalization enhanced by attention can mitigate the offset effect of invalid pixels on mean and variance. Our method was verified on datasets Places2 and CelebA, and it was indicated by the experimental results that the similar methods currently accessible were outperformed by our method.

Northwest University (CN)
Research and Development
Zero hunger
Openalex Percentile: Top 74%
Image Processing and 3D Reconstruction
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.