Masked Face Image Inpainting Based on Generative Adversarial Network

Face image inpainting is a critical task in computer vision due to the intricate semantic and textural features of facial structures. While existing deep learning-based methods have achieved some progress, they often produce blurred or artifactprone results when handling large occlusions, such as face masks. To address these challenges, this paper proposes a novel generative adversarial network (GAN) framework tailored for masked face inpainting. The generator adopts a U-Net architecture enhanced with a multi-scale mixed-attention residual module (MMRM), which integrates multi-branch convolutions for diverse receptive fields and combines spatial-channel attention mechanisms to prioritize semantically relevant features. The decoder further enhances feature fusion through channel attention mechanism, which selectively emphasizes meaningful patterns during feature map reconstruction. A realistic masked face dataset is synthesized using the CelebA database by dynamically adjusting mask positions, sizes, and angles based on facial landmarks, ensuring alignment with real-world scenarios. Quantitative and qualitative evaluations demonstrate that our method outperforms conventional models in both visual quality and quantitative metrics. Ablation studies further validate the effectiveness of MMRM and attention mechanisms in preserving structural coherence and reducing artifacts.

Publication Details

Journal
Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
Published
2025-01-01
Primary Topic
Diverse Scientific and Economic Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Masked Face Image Inpainting Based on Generative Adversarial Network

Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
Diverse Scientific and Economic Studies
article

Masked Face Image Inpainting Based on Generative Adversarial Network

article en

Abstract

Face image inpainting is a critical task in computer vision due to the intricate semantic and textural features of facial structures. While existing deep learning-based methods have achieved some progress, they often produce blurred or artifactprone results when handling large occlusions, such as face masks. To address these challenges, this paper proposes a novel generative adversarial network (GAN) framework tailored for masked face inpainting. The generator adopts a U-Net architecture enhanced with a multi-scale mixed-attention residual module (MMRM), which integrates multi-branch convolutions for diverse receptive fields and combines spatial-channel attention mechanisms to prioritize semantically relevant features. The decoder further enhances feature fusion through channel attention mechanism, which selectively emphasizes meaningful patterns during feature map reconstruction. A realistic masked face dataset is synthesized using the CelebA database by dynamically adjusting mask positions, sizes, and angles based on facial landmarks, ensuring alignment with real-world scenarios. Quantitative and qualitative evaluations demonstrate that our method outperforms conventional models in both visual quality and quantitative metrics. Ablation studies further validate the effectiveness of MMRM and attention mechanisms in preserving structural coherence and reducing artifacts.

Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
Openalex Percentile: Top 37%
Diverse Scientific and Economic Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Masked Face Image Inpainting Based on Generative Adversarial Network · Repository of the Academy's Library (Library of the Hungarian Academy of Sciences) (2025) | TGRS Research Map | TGRS