Exploring Feature Map Correlations for Effective Fake Face Detection

In recent years, the internet and social media platforms have seen a massive influx of data, particularly images. To effectively identify fake content, we employ a deepfake detection technique aimed at determining the authenticity of uploaded material. In this paper, we achieve fake face detection with high accuracy by utilizing deep feature map relations. Our approach leverages transfer learning techniques from pretrained deep models, such as VGG16, VGG19, and ResNet50. We analyze the generated Gram Matrix of each layer, where deep feature relations are similar to the covariance matrix, reflecting correlations between different feature maps. These features are used to classify content as fake or real using a simple CNN, and the results are reported and compared. This study explores deep feature map relations as crucial indicators for detecting inconsistencies introduced by image generators. By employing pre-trained networks, we analyze and explore feature map relations generated in each layer as higher-order quality features. Experimental results demonstrate that the proposed inconsistency detection feature yields satisfactory results. The entire implementation of this work can be found at https: //github.com/hnarges91/Fake-Face-Detection.

Authors

Institutions

Publication Details

Published
2024-10-09
DOI
https://doi.org/10.1109/ist64061.2024.10843660
Citations
1
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Feature Map Correlations for Effective Fake Face Detection

Farha H. Taher, Narges Honarjoo, Azadeh Mansouri
1 citations
Face recognition and analysis
0.25
article

Exploring Feature Map Correlations for Effective Fake Face Detection

Farha H. Taher, Narges Honarjoo, Azadeh Mansouri
article en
1 citations

Abstract

In recent years, the internet and social media platforms have seen a massive influx of data, particularly images. To effectively identify fake content, we employ a deepfake detection technique aimed at determining the authenticity of uploaded material. In this paper, we achieve fake face detection with high accuracy by utilizing deep feature map relations. Our approach leverages transfer learning techniques from pretrained deep models, such as VGG16, VGG19, and ResNet50. We analyze the generated Gram Matrix of each layer, where deep feature relations are similar to the covariance matrix, reflecting correlations between different feature maps. These features are used to classify content as fake or real using a simple CNN, and the results are reported and compared. This study explores deep feature map relations as crucial indicators for detecting inconsistencies introduced by image generators. By employing pre-trained networks, we analyze and explore feature map relations generated in each layer as higher-order quality features. Experimental results demonstrate that the proposed inconsistency detection feature yields satisfactory results. The entire implementation of this work can be found at https: //github.com/hnarges91/Fake-Face-Detection.

Kharazmi University (IR)
Openalex Percentile: Top 42%
Face recognition and analysis
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.