Enhanced Human Face Recall by Reconstruction of Real and Synthetic Occlusions

This study investigates occluded face recognition using a Complete Face Recovery Generative Adversarial Network (CFR-GAN). It directly addresses the complexities of identifying faces obscured by real-world occlusions, while underlining the critical role of high-quality input data. The CFR-GAN is trained on both occluded and rotated face datasets, with synthetic occlusions applied for data augmentation. In Experiment 1, the model achieved a poor result of 15.80% accuracy for reconstructing images with sunglasses and 24.11% for masked faces, but produced a consistent recall rate of 100%. Experiment 2 utilised the Labelled Faces in the Wild (LFW) dataset, where the CFR-GAN yielded an accuracy of 52.27%. Despite improvements with higher-quality inputs, the model introduced artefacts and misaligned features, underscoring the ongoing difficulties in occluded face recognition. The results underscored the importance of data quality, advanced training techniques, and refined evaluation metrics in addressing these real-world challenges. While this work demonstrates promise, further study is required to translate these findings into practical applications in biometric security and related areas.

Authors

Institutions

Publication Details

Published
2024-11-18
DOI
https://doi.org/10.1109/icdici62993.2024.10810768
Citations
1
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.25

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhanced Human Face Recall by Reconstruction of Real and Synthetic Occlusions

Dane Brown, Iffat Mollah
1 citations
Face recognition and analysis
0.25
article

Enhanced Human Face Recall by Reconstruction of Real and Synthetic Occlusions

Dane Brown, Iffat Mollah
article en
1 citations

Abstract

This study investigates occluded face recognition using a Complete Face Recovery Generative Adversarial Network (CFR-GAN). It directly addresses the complexities of identifying faces obscured by real-world occlusions, while underlining the critical role of high-quality input data. The CFR-GAN is trained on both occluded and rotated face datasets, with synthetic occlusions applied for data augmentation. In Experiment 1, the model achieved a poor result of 15.80% accuracy for reconstructing images with sunglasses and 24.11% for masked faces, but produced a consistent recall rate of 100%. Experiment 2 utilised the Labelled Faces in the Wild (LFW) dataset, where the CFR-GAN yielded an accuracy of 52.27%. Despite improvements with higher-quality inputs, the model introduced artefacts and misaligned features, underscoring the ongoing difficulties in occluded face recognition. The results underscored the importance of data quality, advanced training techniques, and refined evaluation metrics in addressing these real-world challenges. While this work demonstrates promise, further study is required to translate these findings into practical applications in biometric security and related areas.

Rhodes University (ZA)
Rhodes University
Openalex Percentile: Top 43%
Face recognition and analysis
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.