Decision-Aid Framework for Face Authentication Detection Using ResNext50 and BiLSTM to Enhance Media Integrity
This paper presents a decision-aid framework for face authentication detection that integrates ResNext50 with Bidirectional Long Short-Term Memory (BiLSTM) networks to enhance media integrity and improve deepfake detection. Unlike conventional approaches that focus solely on spatial features, the proposed hybrid model incorporates temporal analysis, enabling the detection of subtle manipulations distributed across sequential video frames. ResNext50 serves as a robust spatial feature extractor from cropped facial regions, while BiLSTM captures bidirectional temporal dependencies, enriching the model’s contextual understanding and temporal sensitivity. The model was evaluated on three benchmark datasets—FaceForensics++, DFDC, and Celeb-DF—and demonstrated superior performance in classifying real versus manipulated facial content. The hybrid ResNext50 + BiLSTM model achieved a final accuracy of 96.11%, precision of 96.42%, recall of 96.68%, F1-score of 96.23%, and an AUC of 98.89%, outperforming the standalone ResNext50 and other state-of-the-art CNN-based approaches. These improvements reflect a notable reduction in both false positives and false negatives, which is critical for real-world face authentication systems. The proposed framework offers a scalable and robust solution for applications in digital forensics, media verification, and cybersecurity, where maintaining trust in visual content is paramount. This study underscores the pivotal role of temporal modeling in improving the reliability of face manipulation detection. Future work will explore advanced fusion strategies, lightweight architectures for real-time deployment, and cross-dataset generalization to enhance adaptability in diverse, real-world scenarios.
Authors
- Saqib Saleem Abdullah (ORCID: https://orcid.org/0000-0003-4283-2270)
- Nur Hanis Sabrina Suhaimi (ORCID: https://orcid.org/0000-0002-3410-8533)
- Sarah Khadijah Taylor (ORCID: https://orcid.org/0000-0002-5586-5525)
- Siti Norul Huda Sheikh Abdullah (ORCID: https://orcid.org/0000-0002-2602-7805)
- Tarik Abu-Ain (ORCID: https://orcid.org/0000-0002-8023-7600)
- Ayat Abd-Muti Alrawahneh
Institutions
- Saudi Electronic University (SA)
- University of Cyberjaya (MY)
- National University of Malaysia (MY)
Publication Details
- Journal
- IEEE Access
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/access.2025.3569792
- Citations
- 4
- Primary Topic
- Face recognition and analysis
- Type
- article
- Field-Weighted Citation Impact
- 5.10
Funders
- Ministry of Higher Education, Malaysia