Advanced framework for multilevel detection of digital video forgeries

The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.

Authors

Institutions

Publication Details

Journal
Annals of the New York Academy of Sciences
Published
2024-11-19
DOI
https://doi.org/10.1111/nyas.15257
Citations
2
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Advanced framework for multilevel detection of digital video forgeries

Utkarsh Singh, Sandeep Rathor, Manoj Kumar
2 citations
Annals of the New York Academy of Sciences
Digital Media Forensic Detection
0.50
article

Advanced framework for multilevel detection of digital video forgeries

Utkarsh Singh, Sandeep Rathor, Manoj Kumar
article en
2 citations

Abstract

The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.

Annals of the New York Academy of SciencesVol. 1543(1)
GLA University (IN)
Openalex Percentile: Top 33%
Digital Media Forensic Detection
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Advanced framework for multilevel detection of digital video forgeries — Utkarsh Singh, Sandeep Rathor, et al. · Annals of the New York Academy of Sciences (2024) | TGRS Research Map | TGRS