PViT: A Hybrid Model for Deepfake Face Detection using Patch Vision Transformers and Deep Learning

The proliferation of AI-generated deepfakes, particularly facial image forgeries, poses a significant threat to digital security by facilitating misinformation, identity theft, and privacy breaches. Traditional detection approaches, primarily based on Convolutional Neural Networks (CNNs), often exhibit limited effectiveness when confronted with highly refined or subtle manipulations, leading to compromised detection performance. To address this challenge, this study explores the application of Vision Transformers (ViTs), which leverage selfattention mechanisms to capture fine-grained inconsistencies in visual patterns. This research proposed a hybrid deepfake detection model that integrates patch-oriented ViTs with CNN architectures to improve discriminative feature extraction. Experimental evaluation on benchmark datasets demonstrates that the proposed model achieved a detection accuracy 99%, precision $\mathbf{9 9 \%}$, recall $\mathbf{9 9\%}$, F1-Score $\mathbf{9 9\%}$ on a validation set comprising 76,161 facial images, outperforming conventional CNN-based methods. These results highlight the potential of transformerbased architectures in advancing the robustness and reliability of deepfake detection systems, thereby contributing to the protection of digital authenticity and information integrity.

Authors

Institutions

Publication Details

Published
2025-06-18
DOI
https://doi.org/10.1109/ntms65597.2025.11076897
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PViT: A Hybrid Model for Deepfake Face Detection using Patch Vision Transformers and Deep Learning

Zunera Jalil, Andrew Marrington, Farkhund Iqbal, Muhammad Aatif et al.
Face recognition and analysis
article

PViT: A Hybrid Model for Deepfake Face Detection using Patch Vision Transformers and Deep Learning

Zunera Jalil, Andrew Marrington, Farkhund Iqbal, Muhammad Aatif, Iqra Ambreen
article en

Abstract

The proliferation of AI-generated deepfakes, particularly facial image forgeries, poses a significant threat to digital security by facilitating misinformation, identity theft, and privacy breaches. Traditional detection approaches, primarily based on Convolutional Neural Networks (CNNs), often exhibit limited effectiveness when confronted with highly refined or subtle manipulations, leading to compromised detection performance. To address this challenge, this study explores the application of Vision Transformers (ViTs), which leverage selfattention mechanisms to capture fine-grained inconsistencies in visual patterns. This research proposed a hybrid deepfake detection model that integrates patch-oriented ViTs with CNN architectures to improve discriminative feature extraction. Experimental evaluation on benchmark datasets demonstrates that the proposed model achieved a detection accuracy 99%, precision $\mathbf{9 9 \%}$, recall $\mathbf{9 9\%}$, F1-Score $\mathbf{9 9\%}$ on a validation set comprising 76,161 facial images, outperforming conventional CNN-based methods. These results highlight the potential of transformerbased architectures in advancing the robustness and reliability of deepfake detection systems, thereby contributing to the protection of digital authenticity and information integrity.

Air University (PK), Zayed University (AE)
Openalex Percentile: Top 82%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.