Multimodal Large Models for Image Tampering Detection and Explanation: From Detection to Reasoning
With the rise of AI-generated content, image tampering has become a growing concern across legal, journalistic, and public safety domains. Existing models often lack interpretability and sensitivity to subtle manipulations. In this work, we propose a lightweight and explainable multimodal framework based on LLaVA-1.5 for image tampering detection and reasoning. By constructing task-specific datasets and reformulating detection as a visual question answering task, our model can identify, describe, and explain manipulations in natural language. We enhance low-level forensic awareness through a dual-branch feature fusion of CLIP semantics and TruFor forensic cues. Experimental results on four benchmarks demonstrate competitive detection accuracy and superior performance in tampering description and rationale explanation. Our method offers a deployable and interpretable solution for real-world content forensics.
Authors
- Heng Huang (ORCID: https://orcid.org/0000-0003-3036-2961)
- Yuchen Li
- Xin Jin (ORCID: https://orcid.org/0000-0003-3873-1653)
- Xianglong Zeng
- Chenfeng Du
Institutions
- University of Science and Technology of China (CN)
- Beijing Electronic Science and Technology Institute (CN)
Publication Details
- Published
- 2025-10-08
- DOI
- https://doi.org/10.1145/3746265.3759676
- Primary Topic
- Digital Media Forensic Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00