UMI-Net: Unveiling Multi-Domain Inconsistency Learning with Structure Guidance for Image Manipulation Localization
The growing demand for digital image authenticity verification has driven advances in Image Manipulation Localization (IML). Although existing methods aim to capture tampering-induced inconsistency features, such cues are often subtle. They can be obscured by representations dominated by high-level semantic information, thereby limiting the model’s ability to detect fine-grained anomalies. To address this challenge, we propose UMI-Net, an inconsistency-driven framework for image manipulation localization. Specifically, UMI-Net comprises two core components: an Inconsistency-Aware Encoder (IAE) and a Structure-Constrained Decoder (SCD). The IAE employs a Dynamic Frequency-Domain Gating Module (DFG) and a Cross-Domain Inconsistency Interaction Module (CII) to capture cross-domain inconsistency responses under semantic structure constraints, thereby learning robust inconsistency representations. Subsequently, the SCD introduces global constraints through a Multi-Scale Structure Prior Extraction Module (MSPE) and progressively refines the localization results using a Structure-Aware Refinement Module (SARM), effectively filtering out background noise and reconstructing clear and continuous tampering boundaries. Extensive experiments on multiple benchmark datasets demonstrate that UMI-Net outperforms existing methods in localization accuracy and robustness in most cases, while also showing promising potential for applications in image authenticity verification and multimedia forensics.
Authors
- 鲍士水
- Yuyan Liu (ORCID: https://orcid.org/0000-0003-1786-9522)
- Bin Ge (ORCID: https://orcid.org/0000-0001-9050-1105)
- Junshuai Zheng (ORCID: https://orcid.org/0000-0001-6489-8276)
- Chenxing Xia (ORCID: https://orcid.org/0009-0007-8138-9204)
- Xinyu Chen
- Xiuju Gao
- Anjun Liu
Institutions
- Anhui University of Science and Technology (CN)
Publication Details
- Journal
- Electronics
- Published
- 2026-11-16
- DOI
- https://doi.org/10.3390/electronics15225337
- Primary Topic
- Digital Media Forensic Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00