Face inpainting algorithm based on predictive filtering and multi-prior guidance

To solve the structural distortion and artifacts of existing face image inpainting algorithms under large-area mask, this paper proposes a generative face image inpainting algorithm based on predictive filtering and multi-priority guidance. The inpainting process of this algorithm is divided into two stages. In the first stage, firstly, the face sketch of masked face is utilized as a prior information to guide the edge prediction network to generate the complete face edges. Then the landmark information in the masked region of the face image is predicted using Mobilenet. In the second stage, the face sketch, the predicted edges and landmarks are used as prior information, and we introduce feature-level and image-level predictive filtering in the face inpainting module to obtain the high-quality face inpainting results. The experimental results on Celeba-HQ dataset and FFHQ dataset show that the proposed algorithm can achieve better inpainting results for large-area masked face. Compared with other six representative face inpainting algorithms, the proposed algorithm achieves effective improvement in three criterion: PSNR, SSIM and FID.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1145/3703935.3704069
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Face inpainting algorithm based on predictive filtering and multi-prior guidance

Z. He, Fuping Wang, Jiahao Wang
Generative Adversarial Networks and Image Synthesis
article

Face inpainting algorithm based on predictive filtering and multi-prior guidance

Z. He, Fuping Wang, Jiahao Wang
article en

Abstract

To solve the structural distortion and artifacts of existing face image inpainting algorithms under large-area mask, this paper proposes a generative face image inpainting algorithm based on predictive filtering and multi-priority guidance. The inpainting process of this algorithm is divided into two stages. In the first stage, firstly, the face sketch of masked face is utilized as a prior information to guide the edge prediction network to generate the complete face edges. Then the landmark information in the masked region of the face image is predicted using Mobilenet. In the second stage, the face sketch, the predicted edges and landmarks are used as prior information, and we introduce feature-level and image-level predictive filtering in the face inpainting module to obtain the high-quality face inpainting results. The experimental results on Celeba-HQ dataset and FFHQ dataset show that the proposed algorithm can achieve better inpainting results for large-area masked face. Compared with other six representative face inpainting algorithms, the proposed algorithm achieves effective improvement in three criterion: PSNR, SSIM and FID.

Xi’an University of Posts and Telecommunications (CN)
Openalex Percentile: Top 70%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Face inpainting algorithm based on predictive filtering and multi-prior guidance — Z. He, Fuping Wang, et al. · (2024) | TGRS Research Map | TGRS