Research on Real-Time Deepfake Image Detection System Based on a Self-Supervised Learning Framework

The rapid evolution of deepfake technology raises significant security and ethical concerns, as its potential misuse could lead to the spread of disinformation. In this study, we propose an advanced real-time deepfake image detection system based on a self-supervised learning framework. The model is based on the most advanced visual transformers (ViTs) and integrates contrastive representation learning in order to effectively distinguish between manipulated content and real images. Furthermore, we have incorporated a temporal consistency module that leverages subtle temporal artefacts to enhance the precision of detection, particularly in video frame sequences. The architectural design is devised to capture spatial and temporal anomalies, thereby ensuring robust detection performance in real-time scenarios. The experimental outcomes on benchmark datasets of Celeb-DF demonstrate that the proposed model exhibits a notable superiority to the existing deepfake detection methods in terms of accuracy and efficiency.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/iaecst64597.2024.11118130
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Real-Time Deepfake Image Detection System Based on a Self-Supervised Learning Framework

Zehang Li, Yun Peng, Xinyu Kong, Z. J. Guo
Anomaly Detection Techniques and Applications
article

Research on Real-Time Deepfake Image Detection System Based on a Self-Supervised Learning Framework

Zehang Li, Yun Peng, Xinyu Kong, Z. J. Guo
article en

Abstract

The rapid evolution of deepfake technology raises significant security and ethical concerns, as its potential misuse could lead to the spread of disinformation. In this study, we propose an advanced real-time deepfake image detection system based on a self-supervised learning framework. The model is based on the most advanced visual transformers (ViTs) and integrates contrastive representation learning in order to effectively distinguish between manipulated content and real images. Furthermore, we have incorporated a temporal consistency module that leverages subtle temporal artefacts to enhance the precision of detection, particularly in video frame sequences. The architectural design is devised to capture spatial and temporal anomalies, thereby ensuring robust detection performance in real-time scenarios. The experimental outcomes on benchmark datasets of Celeb-DF demonstrate that the proposed model exhibits a notable superiority to the existing deepfake detection methods in terms of accuracy and efficiency.

Xinjiang University (CN)
Openalex Percentile: Top 72%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Real-Time Deepfake Image Detection System Based on a Self-Supervised Learning Framework — Zehang Li, Yun Peng, et al. · (2024) | TGRS Research Map | TGRS