Multimodal Large Models for Image Tampering Detection and Explanation: From Detection to Reasoning

With the rise of AI-generated content, image tampering has become a growing concern across legal, journalistic, and public safety domains. Existing models often lack interpretability and sensitivity to subtle manipulations. In this work, we propose a lightweight and explainable multimodal framework based on LLaVA-1.5 for image tampering detection and reasoning. By constructing task-specific datasets and reformulating detection as a visual question answering task, our model can identify, describe, and explain manipulations in natural language. We enhance low-level forensic awareness through a dual-branch feature fusion of CLIP semantics and TruFor forensic cues. Experimental results on four benchmarks demonstrate competitive detection accuracy and superior performance in tampering description and rationale explanation. Our method offers a deployable and interpretable solution for real-world content forensics.

Authors

Institutions

Publication Details

Published
2025-10-08
DOI
https://doi.org/10.1145/3746265.3759676
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Large Models for Image Tampering Detection and Explanation: From Detection to Reasoning

Heng Huang, Yuchen Li, Xin Jin, Xianglong Zeng et al.
Digital Media Forensic Detection
article

Multimodal Large Models for Image Tampering Detection and Explanation: From Detection to Reasoning

Heng Huang, Yuchen Li, Xin Jin, Xianglong Zeng, Chenfeng Du
article en

Abstract

With the rise of AI-generated content, image tampering has become a growing concern across legal, journalistic, and public safety domains. Existing models often lack interpretability and sensitivity to subtle manipulations. In this work, we propose a lightweight and explainable multimodal framework based on LLaVA-1.5 for image tampering detection and reasoning. By constructing task-specific datasets and reformulating detection as a visual question answering task, our model can identify, describe, and explain manipulations in natural language. We enhance low-level forensic awareness through a dual-branch feature fusion of CLIP semantics and TruFor forensic cues. Experimental results on four benchmarks demonstrate competitive detection accuracy and superior performance in tampering description and rationale explanation. Our method offers a deployable and interpretable solution for real-world content forensics.

University of Science and Technology of China (CN), Beijing Electronic Science and Technology Institute (CN)
Openalex Percentile: Top 72%
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multimodal Large Models for Image Tampering Detection and Explanation: From Detection to Reasoning — Heng Huang, Yuchen Li, et al. · (2025) | TGRS Research Map | TGRS