UMI-Net: Unveiling Multi-Domain Inconsistency Learning with Structure Guidance for Image Manipulation Localization

The growing demand for digital image authenticity verification has driven advances in Image Manipulation Localization (IML). Although existing methods aim to capture tampering-induced inconsistency features, such cues are often subtle. They can be obscured by representations dominated by high-level semantic information, thereby limiting the model’s ability to detect fine-grained anomalies. To address this challenge, we propose UMI-Net, an inconsistency-driven framework for image manipulation localization. Specifically, UMI-Net comprises two core components: an Inconsistency-Aware Encoder (IAE) and a Structure-Constrained Decoder (SCD). The IAE employs a Dynamic Frequency-Domain Gating Module (DFG) and a Cross-Domain Inconsistency Interaction Module (CII) to capture cross-domain inconsistency responses under semantic structure constraints, thereby learning robust inconsistency representations. Subsequently, the SCD introduces global constraints through a Multi-Scale Structure Prior Extraction Module (MSPE) and progressively refines the localization results using a Structure-Aware Refinement Module (SARM), effectively filtering out background noise and reconstructing clear and continuous tampering boundaries. Extensive experiments on multiple benchmark datasets demonstrate that UMI-Net outperforms existing methods in localization accuracy and robustness in most cases, while also showing promising potential for applications in image authenticity verification and multimedia forensics.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2026-11-16
DOI
https://doi.org/10.3390/electronics15225337
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

UMI-Net: Unveiling Multi-Domain Inconsistency Learning with Structure Guidance for Image Manipulation Localization

鲍士水, Yuyan Liu, Bin Ge, Junshuai Zheng et al.
4 links
Electronics
Digital Media Forensic Detection
article

UMI-Net: Unveiling Multi-Domain Inconsistency Learning with Structure Guidance for Image Manipulation Localization

鲍士水, Yuyan Liu, Bin Ge, Junshuai Zheng, Chenxing Xia, Xinyu Chen, Xiuju Gao, Anjun Liu
article en

Abstract

The growing demand for digital image authenticity verification has driven advances in Image Manipulation Localization (IML). Although existing methods aim to capture tampering-induced inconsistency features, such cues are often subtle. They can be obscured by representations dominated by high-level semantic information, thereby limiting the model’s ability to detect fine-grained anomalies. To address this challenge, we propose UMI-Net, an inconsistency-driven framework for image manipulation localization. Specifically, UMI-Net comprises two core components: an Inconsistency-Aware Encoder (IAE) and a Structure-Constrained Decoder (SCD). The IAE employs a Dynamic Frequency-Domain Gating Module (DFG) and a Cross-Domain Inconsistency Interaction Module (CII) to capture cross-domain inconsistency responses under semantic structure constraints, thereby learning robust inconsistency representations. Subsequently, the SCD introduces global constraints through a Multi-Scale Structure Prior Extraction Module (MSPE) and progressively refines the localization results using a Structure-Aware Refinement Module (SARM), effectively filtering out background noise and reconstructing clear and continuous tampering boundaries. Extensive experiments on multiple benchmark datasets demonstrate that UMI-Net outperforms existing methods in localization accuracy and robustness in most cases, while also showing promising potential for applications in image authenticity verification and multimedia forensics.

ElectronicsVol. 15(22)
Anhui University of Science and Technology (CN)
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon