An Ensemble Deep Learning Framework for Deepfake Video Detection Using ResNet Models

Deepfake technology has raised growing concerns due to its potential to enable misinformation, identity fraud, and security threats through manipulated digital content. As these risks continue to increase, the development of reliable deepfake detection methods has become essential. In this study, a spatial feature-based ensemble deep learning framework is proposed to improve detection accuracy and classification stability. Facial regions were first extracted from video frames using the MTCNN algorithm to focus the analysis on relevant facial areas. The proposed framework focuses on spatial facial representations extracted from individual video frames rather than explicit temporal modeling. Subsequently, ResNet50 and ResNet101 were employed as the main spatial feature extractors to obtain deep facial representations at different abstraction levels. ResNet152 was also evaluated experimentally to examine the effect of a deeper feature extraction branch; however, it was not included in the final framework because it increased runtime without improving video-level classification performance. The extracted feature vectors were classified using independent multilayer perceptron (MLP) classifiers, and the final prediction was obtained using a two-model weighted soft voting ensemble. The proposed method was evaluated on a balanced subset of the Celeb-DF dataset using a video-level train-test split to reduce data leakage between training and test sets. Experimental results showed that the final ResNet50–ResNet101 weighted soft voting ensemble achieved 94.17% video-level accuracy, 0.986 AUC, 0.9440 F1-score, and 0.8864 MCC. The two-model ensemble achieved performance comparable to the three-model configuration while providing a more favorable runtime profile. These findings suggest that combining complementary spatial facial representations through weighted soft voting provides a reliable and computationally efficient approach for deepfake video detection.

Authors

Institutions

Publication Details

Journal
Kocaeli Journal of Science and Engineering
Published
2026-11-11
DOI
https://doi.org/10.34088/kojose.1919952
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

An Ensemble Deep Learning Framework for Deepfake Video Detection Using ResNet Models

Coşku Öksüz, Hazal Su Bıçakcı Yeşilkaya, Ömer Talha Kaya
Kocaeli Journal of Science and Engineering
Digital Media Forensic Detection
article

An Ensemble Deep Learning Framework for Deepfake Video Detection Using ResNet Models

Coşku Öksüz, Hazal Su Bıçakcı Yeşilkaya, Ömer Talha Kaya
article en

Abstract

Deepfake technology has raised growing concerns due to its potential to enable misinformation, identity fraud, and security threats through manipulated digital content. As these risks continue to increase, the development of reliable deepfake detection methods has become essential. In this study, a spatial feature-based ensemble deep learning framework is proposed to improve detection accuracy and classification stability. Facial regions were first extracted from video frames using the MTCNN algorithm to focus the analysis on relevant facial areas. The proposed framework focuses on spatial facial representations extracted from individual video frames rather than explicit temporal modeling. Subsequently, ResNet50 and ResNet101 were employed as the main spatial feature extractors to obtain deep facial representations at different abstraction levels. ResNet152 was also evaluated experimentally to examine the effect of a deeper feature extraction branch; however, it was not included in the final framework because it increased runtime without improving video-level classification performance. The extracted feature vectors were classified using independent multilayer perceptron (MLP) classifiers, and the final prediction was obtained using a two-model weighted soft voting ensemble. The proposed method was evaluated on a balanced subset of the Celeb-DF dataset using a video-level train-test split to reduce data leakage between training and test sets. Experimental results showed that the final ResNet50–ResNet101 weighted soft voting ensemble achieved 94.17% video-level accuracy, 0.986 AUC, 0.9440 F1-score, and 0.8864 MCC. The two-model ensemble achieved performance comparable to the three-model configuration while providing a more favorable runtime profile. These findings suggest that combining complementary spatial facial representations through weighted soft voting provides a reliable and computationally efficient approach for deepfake video detection.

Kocaeli Journal of Science and EngineeringVol. 2026(17)
Bakırçay Üniversitesi (TR)
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon