State of the art in image forgery detection using large language models to identify gaps for improving accuracy and reducing hallucinations

In recent years, large language models have demonstrated remarkable capabilities across a wide range of natural language processing tasks. This success has prompted researchers to extend these models to the visual domain by integrating them with image analysis techniques for tasks, such as digital tamper detection. In the context of image forgery detection, large language models have been used to verify image authenticity by distinguishing genuine from manipulated images, a task of critical importance in an era increasingly reliant on digital media; however, numerous studies have shown that these models often exhibit hallucinations, producing plausible yet incorrect outputs. Despite significant progress, the literature still lacks a comprehensive understanding of the root causes of such hallucinations in multimodal image verification systems. To approach this gap, this paper presents a thorough review of state-of-the-art large language model-based image forgery detection approaches. It assesses key architectural components and fundamental concerns, contributing to hallucinations and reduced accuracy. This holistic analysis identifies critical factors that, if systematically resolved, could significantly enhance the model accuracy and reliability of forgery detection. The findings culminate in a state-of-the-art perspective on the field, emphasizing particular gaps and promising directions for improving LLM performance and mitigating hallucination effects in future image forgery detection research.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-11-19
DOI
https://doi.org/10.1007/s44163-026-02174-3
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

State of the art in image forgery detection using large language models to identify gaps for improving accuracy and reducing hallucinations

Hein S. Venter, Thobeka Langa
Discover Artificial Intelligence
Digital Media Forensic Detection
article

State of the art in image forgery detection using large language models to identify gaps for improving accuracy and reducing hallucinations

Hein S. Venter, Thobeka Langa
article en

Abstract

In recent years, large language models have demonstrated remarkable capabilities across a wide range of natural language processing tasks. This success has prompted researchers to extend these models to the visual domain by integrating them with image analysis techniques for tasks, such as digital tamper detection. In the context of image forgery detection, large language models have been used to verify image authenticity by distinguishing genuine from manipulated images, a task of critical importance in an era increasingly reliant on digital media; however, numerous studies have shown that these models often exhibit hallucinations, producing plausible yet incorrect outputs. Despite significant progress, the literature still lacks a comprehensive understanding of the root causes of such hallucinations in multimodal image verification systems. To approach this gap, this paper presents a thorough review of state-of-the-art large language model-based image forgery detection approaches. It assesses key architectural components and fundamental concerns, contributing to hallucinations and reduced accuracy. This holistic analysis identifies critical factors that, if systematically resolved, could significantly enhance the model accuracy and reliability of forgery detection. The findings culminate in a state-of-the-art perspective on the field, emphasizing particular gaps and promising directions for improving LLM performance and mitigating hallucination effects in future image forgery detection research.

Discover Artificial IntelligenceVol. 6(1)
University of Pretoria (ZA)
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon