Images Inpainting via Region Convolution and Feature Fusion

Image inpainting aims to fill damaged regions with reasonable structure, fine texture details, and semantically consistent content. However, existing deep learning algorithms mostly employ standard convolution architecture on damaged images, resulting in meaningless content such as color differences, blurring, and other artifacts. Aiming at the problem that the standard convolution methods cannot fully exploit the known regions to predict the damaged region features, this paper proposes an efficient region convolution (ERC) module to distinguish between known and damaged regions, and effectively prevent interference from invalid pixels through feature migration, additionally, the sampling regions are dynamically expanded to reconstruct the damaged regions more accurately. This article proposes a novel inpainting network that utilizes an encoder-decoder framework to restore images that are both semantically reasonable and visually realistic. Extensive experiments on two public datasets, Paris StreetView and CelebA, both qualitatively and quantitatively prove the strengths of the proposed approach.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1145/3700906.3700935
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Images Inpainting via Region Convolution and Feature Fusion

Bin Zhou, Zhisheng Gao, Jinrong Li
Generative Adversarial Networks and Image Synthesis
article

Images Inpainting via Region Convolution and Feature Fusion

Bin Zhou, Zhisheng Gao, Jinrong Li
article en

Abstract

Image inpainting aims to fill damaged regions with reasonable structure, fine texture details, and semantically consistent content. However, existing deep learning algorithms mostly employ standard convolution architecture on damaged images, resulting in meaningless content such as color differences, blurring, and other artifacts. Aiming at the problem that the standard convolution methods cannot fully exploit the known regions to predict the damaged region features, this paper proposes an efficient region convolution (ERC) module to distinguish between known and damaged regions, and effectively prevent interference from invalid pixels through feature migration, additionally, the sampling regions are dynamically expanded to reconstruct the damaged regions more accurately. This article proposes a novel inpainting network that utilizes an encoder-decoder framework to restore images that are both semantically reasonable and visually realistic. Extensive experiments on two public datasets, Paris StreetView and CelebA, both qualitatively and quantitatively prove the strengths of the proposed approach.

Xihua University (CN)
Openalex Percentile: Top 78%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.