A method for detecting deepfake faces by integrating multi-scale deep-shallow spatial and frequency features

In recent years, deep learning technology has been excessively used in the creation of fake videos. Deepfake technology alters or replaces the facial information of the original video, synthesizes false voices, and is used to create pornographic films, fake news, political rumors, and so on, posing significant challenges to the authenticity of information and personal privacy. Currently, most face deepfake detection networks are based on single-scale and single-source detection research, and the proposed networks and methods often lack the ability to recognize unknown attack methods and generalization ability. To address these issues, this paper proposes a face deepfake detection method that integrates deep and shallow multi-scale spatial and frequency-domain features to achieve high-accuracy recognition of deepfake faces. The network is based on feature extraction from shallow and deep layers, where the shallow branch captures detailed information from low-level features to detect small-scale targets such as minor noise, while the deep branch focuses on detecting larger and higher-level fake features with a larger receptive field. Each branch adopts a method to fuse multi-scale spatial and frequency-domain features. Multi-scale features can capture information at different levels and granularities, while frequency-domain features can supplement fake traces that are difficult to detect in the spatial domain. Extensive experiments show that tthis framework outperforms most face spoofing detection networks and achieves good performance.

Authors

Institutions

Publication Details

Published
2024-09-14
DOI
https://doi.org/10.1145/3697355.3697361
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A method for detecting deepfake faces by integrating multi-scale deep-shallow spatial and frequency features

Xiping He, C. Zhang, Zihan Shang
Digital Media Forensic Detection
article

A method for detecting deepfake faces by integrating multi-scale deep-shallow spatial and frequency features

Xiping He, C. Zhang, Zihan Shang
article en

Abstract

In recent years, deep learning technology has been excessively used in the creation of fake videos. Deepfake technology alters or replaces the facial information of the original video, synthesizes false voices, and is used to create pornographic films, fake news, political rumors, and so on, posing significant challenges to the authenticity of information and personal privacy. Currently, most face deepfake detection networks are based on single-scale and single-source detection research, and the proposed networks and methods often lack the ability to recognize unknown attack methods and generalization ability. To address these issues, this paper proposes a face deepfake detection method that integrates deep and shallow multi-scale spatial and frequency-domain features to achieve high-accuracy recognition of deepfake faces. The network is based on feature extraction from shallow and deep layers, where the shallow branch captures detailed information from low-level features to detect small-scale targets such as minor noise, while the deep branch focuses on detecting larger and higher-level fake features with a larger receptive field. Each branch adopts a method to fuse multi-scale spatial and frequency-domain features. Multi-scale features can capture information at different levels and granularities, while frequency-domain features can supplement fake traces that are difficult to detect in the spatial domain. Extensive experiments show that tthis framework outperforms most face spoofing detection networks and achieves good performance.

Chongqing Technology and Business University (CN)
Openalex Percentile: Top 77%
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.