Research and Performance Evaluation of Deepfake Video Detection Method Integrated Spatio-Temporal Attention Mechanism

With the rapid development of deep learning and computer vision technology, Deepfake technology has been able to generate highly realistic fake videos, which brings serious security and ethical challenges to society. Existing detection methods have insufficient ability to deal with the evolving deepfake technology, especially when dealing with the spatio-temporal characteristics of videos. To solve this problem, a deepfake video detection algorithm based on Spatio-Temporal Attention mechanism is proposed. By fusing the Spatio-Temporal information of the video, an Attention-Driven LSTM network (ADLNet) is designed, which uses the attention mechanism to accurately identify the forgery traces and significantly improves the detection effect. The ACC and AUC on the public deepfake dataset FaceForensics++ are 97.17%and 99.33%respectively, and the ACC and AUC on the Celeb-DF dataset are 96.78%and 98.36%respectively. The experimental results and visualization verify that the proposed ADLNet model has strong robustness and application prospects in extracting spatio-temporal artifacts.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1145/3702370.3702380
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research and Performance Evaluation of Deepfake Video Detection Method Integrated Spatio-Temporal Attention Mechanism

Vladimir Y. Mariano, Ruofan Wang
Video Surveillance and Tracking Methods
article

Research and Performance Evaluation of Deepfake Video Detection Method Integrated Spatio-Temporal Attention Mechanism

Vladimir Y. Mariano, Ruofan Wang
article en

Abstract

With the rapid development of deep learning and computer vision technology, Deepfake technology has been able to generate highly realistic fake videos, which brings serious security and ethical challenges to society. Existing detection methods have insufficient ability to deal with the evolving deepfake technology, especially when dealing with the spatio-temporal characteristics of videos. To solve this problem, a deepfake video detection algorithm based on Spatio-Temporal Attention mechanism is proposed. By fusing the Spatio-Temporal information of the video, an Attention-Driven LSTM network (ADLNet) is designed, which uses the attention mechanism to accurately identify the forgery traces and significantly improves the detection effect. The ACC and AUC on the public deepfake dataset FaceForensics++ are 97.17%and 99.33%respectively, and the ACC and AUC on the Celeb-DF dataset are 96.78%and 98.36%respectively. The experimental results and visualization verify that the proposed ADLNet model has strong robustness and application prospects in extracting spatio-temporal artifacts.

Xinzhou Teachers University (CN), National University (PH), University of the Philippines Manila (PH)
Openalex Percentile: Top 78%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.