Leakage-Aware Deepfake Video Detection and Explainable Verification: Dataset Auditing, Split Design and Cross-Dataset Evaluation
Deepfake detectors often score well on benchmarks but degrade on videos from other datasets, manipulation methods and compression levels. This work studies deepfake video detection with emphasis on cross-dataset generalization, dataset integrity and reliable evaluation, using EfficientNet-B4 and Xception classifiers on FaceForensics++ (C23), Celeb-DF and additional collected videos. An audit of 17,407 video records (14,888 fake; 2,519 real) found zero byte-identical duplicate groups, but an earlier filename-derived split showed about 90.7% filename-token overlap between test and train/validation rows. We construct a revised split (V11) and a sensitivity-analysis candidate (V12) that groups seven candidate visual links within single partitions, with zero cross-split pairs among 76,263 existing visual-match rows. The V11 model reached 86.69% accuracy and 74.76% AUROC on the external Celeb-DF set (6,528 videos), but balanced accuracy was only 51.65% and real-class specificity 3.49%. V12 results reported are validation-only (best AUROC 0.981005 at epoch 2); V12 test and Celeb-DF evaluation are pending. The findings show that accuracy and fake-class recall alone are insufficient evidence of reliable detection.
Authors
- Soumyadeep Ghosh (ORCID: https://orcid.org/0000-0002-4691-3636)
- Ngangbam Indrason (ORCID: https://orcid.org/0000-0003-1237-6008)
- Shaurya Yadav
- Bidyashore LOUREMBAM BIDYASHORE (ORCID: https://orcid.org/0009-0009-8314-9807)
- Ketan AGARWAL Agrawal (ORCID: https://orcid.org/0009-0001-8326-6642)
Institutions
- VIT-AP University (IN)
- Visvesvaraya Technological University (IN)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-20
- DOI
- https://doi.org/10.5281/zenodo.24386320
- Primary Topic
- Digital Media Forensic Detection
- Type
- preprint