CSTAN: A Deepfake Detection Network with CST Attention for Superior Generalization
With the advancement of deepfake forgery technology, highly realistic fake faces have posed serious security risks to sensor-based facial recognition systems. Recent deepfake detection models mainly use binary classification models based on deep learning. Despite achieving high detection accuracy on intra-datasets, these models lack generalization ability when applied to cross-datasets. We propose a deepfake detection model named Channel-Spatial-Triplet Attention Network (CSTAN), which focuses on the difference between real and fake features, thereby enhancing the generality of the detection model. To enhance the feature-learning ability of the model for image forgery regions, we have designed the Channel-Spatial-Triplet (CST) attention mechanism, which extracts subtle local information by capturing feature channels and the spatial correlation of three different scales. Additionally, we propose a novel feature extraction method, OD-ResNet-34, by embedding ODConv into the feature extraction network to enhance its dynamic adaptability to data features. Trained on the FF++ dataset and tested on the Celeb-DF-v1 and Celeb-DF-v2 datasets, the experimental results show that our model has stronger generalization ability in cross-datasets than similar models.
Authors
- Kang Soo You (ORCID: https://orcid.org/0009-0009-5685-2521)
- Cheng Pang (ORCID: https://orcid.org/0000-0001-6469-2366)
- Rushi Lan (ORCID: https://orcid.org/0000-0002-9488-8236)
- Xiaonan Luo (ORCID: https://orcid.org/0000-0002-0751-5045)
- Rui Yang (ORCID: https://orcid.org/0000-0002-5669-7105)
Institutions
- Guilin University of Electronic Technology (CN)
Publication Details
- Journal
- Sensors
- Published
- 2024-11-05
- DOI
- https://doi.org/10.3390/s24227101
- Citations
- 2
- Primary Topic
- Generative Adversarial Networks and Image Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.50
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Guangxi Province
- Guilin University of Electronic Technology