Robust Image Forgery Detection and Localization Framework using Vision Transformers (ViTs)

Image forgery detection has become increasingly critical with the proliferation of image editing tools capable of generating realistic forgeries. Traditional deep learning approaches, such as convolutional neural networks (CNNs), often struggle with capturing global dependencies and subtle inconsistencies across larger image contexts. To address these challenges, this paper proposes a novel Vision Transformer(ViT)- based framework for robust image forgery detection and localization. Leveraging the self-attention mechanism of transformers, our approach effectively models long-range dependencies and detects even subtle tampered regions with high precision. The proposed framework processes images as patch embeddings, extracting both local and global features, and outputs a detailed forgery map for accurate localization. We evaluate our method on multiple benchmark datasets containing diverse forgery types, including splicing, cloning, and inpainting. Experimental results demonstrate that the Vit based model outperforms state-of-the-art CNN and GAN-based methods, achieving superior accuracy, precision, and recall. Additionally, qualitative analyses highlight its capability to localize forgeries in complex scenarios. The results underscore the potential of Vision Transformers as a powerful tool for advancing the field of image forgery detection.

Authors

Publication Details

Journal
International Journal of Innovative Technology and Exploring Engineering
Published
2024-12-25
DOI
https://doi.org/10.35940/ijitee.l1012.14011224
Citations
1
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust Image Forgery Detection and Localization Framework using Vision Transformers (ViTs)

M. Giri, Mahesh Enumula, Vikas Sharma
1 citations
International Journal of Innovative Technology and Exploring Engineering
Digital Media Forensic Detection
0.25
article

Robust Image Forgery Detection and Localization Framework using Vision Transformers (ViTs)

M. Giri, Mahesh Enumula, Vikas Sharma
article en
1 citations

Abstract

Image forgery detection has become increasingly critical with the proliferation of image editing tools capable of generating realistic forgeries. Traditional deep learning approaches, such as convolutional neural networks (CNNs), often struggle with capturing global dependencies and subtle inconsistencies across larger image contexts. To address these challenges, this paper proposes a novel Vision Transformer(ViT)- based framework for robust image forgery detection and localization. Leveraging the self-attention mechanism of transformers, our approach effectively models long-range dependencies and detects even subtle tampered regions with high precision. The proposed framework processes images as patch embeddings, extracting both local and global features, and outputs a detailed forgery map for accurate localization. We evaluate our method on multiple benchmark datasets containing diverse forgery types, including splicing, cloning, and inpainting. Experimental results demonstrate that the Vit based model outperforms state-of-the-art CNN and GAN-based methods, achieving superior accuracy, precision, and recall. Additionally, qualitative analyses highlight its capability to localize forgeries in complex scenarios. The results underscore the potential of Vision Transformers as a powerful tool for advancing the field of image forgery detection.

International Journal of Innovative Technology and Exploring EngineeringVol. 14(1)
Peace, Justice and strong institutions
Openalex Percentile: Top 43%
Digital Media Forensic Detection
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Robust Image Forgery Detection and Localization Framework using Vision Transformers (ViTs) — M. Giri, Mahesh Enumula, et al. · International Journal of Innovative Technology and Exploring Engineering (2024) | TGRS Research Map | TGRS