Evidence Fusion for Analyzing Multimodal Image Manipulation

In this paper, we propose a unified multimodal forensic framework for joint image-authenticity detection and manipulation localization. The proposed method integrates frequency-domain features cues with visual representations to improve manipulation-sensitive feature learning. In addition, an object-context mask-refinement module is introduced to enhance pixel-level localization through contextual attention and boundary-aware residual refinement. We compare the proposed method against ten existing state-of-the-art approaches on benchmark datasets for image-level detection and pixel-level localization. Experimental results show that the proposed method achieves the best image-level detection performance, with an overall classification accuracy and Macro F1-score of 99.1%, demonstrating robust discrimination among real, fully synthetic, and tampered images. Furthermore, it achieves category-specific accuracies of 98.8%, 99.9%, and 98.5% for real, fully synthetic, and tampered images, respectively, highlighting its effectiveness across diverse generation and manipulation scenarios.

Authors

Institutions

Publication Details

Journal
International Journal of Pattern Recognition and Artificial Intelligence
Published
2026-08-20
DOI
https://doi.org/10.1142/s0218001426400380
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evidence Fusion for Analyzing Multimodal Image Manipulation

Frank Y. Shih, Naidan Zhang, Mehri R. Aliabadi
International Journal of Pattern Recognition and Artificial Intelligence
Digital Media Forensic Detection
article

Evidence Fusion for Analyzing Multimodal Image Manipulation

Frank Y. Shih, Naidan Zhang, Mehri R. Aliabadi
article en

Abstract

In this paper, we propose a unified multimodal forensic framework for joint image-authenticity detection and manipulation localization. The proposed method integrates frequency-domain features cues with visual representations to improve manipulation-sensitive feature learning. In addition, an object-context mask-refinement module is introduced to enhance pixel-level localization through contextual attention and boundary-aware residual refinement. We compare the proposed method against ten existing state-of-the-art approaches on benchmark datasets for image-level detection and pixel-level localization. Experimental results show that the proposed method achieves the best image-level detection performance, with an overall classification accuracy and Macro F1-score of 99.1%, demonstrating robust discrimination among real, fully synthetic, and tampered images. Furthermore, it achieves category-specific accuracies of 98.8%, 99.9%, and 98.5% for real, fully synthetic, and tampered images, respectively, highlighting its effectiveness across diverse generation and manipulation scenarios.

International Journal of Pattern Recognition and Artificial Intelligence
Twitter (United States) (US)
Peace, Justice and strong institutions, Reduced inequalities
Openalex Percentile: Top 11%
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.