DiRLoc: Disentanglement Representation Learning for Robust Image Forgery Localization
Deep Learning image forgery localization methods have achieved remarkable results but cannot maintain comparable performance when the forgery images are JPEG compressed, a format that is widely used in daily information transmission. The robustness against JPEG compression has become a bottleneck to the practical application of image forgery localization. To address this issue, a robust image forgery localization framework is proposed against the performance degradation caused by JPEG compression. Specifically, a cutting-edge progressive disentanglement strategy is proposed that incorporates coarse-grained image disentanglement to mitigate the detrimental effects of general JPEG compression, while harnessing the ability of fine-grained element disentanglement to separate multi-scale artifacts, thereby minimizing interference from content information. Moreover, the decision strategy is carefully designed to reinforce subtle signals from tampered areas, including artifacts fusion block reasoning multi-scale artifacts and dual attention block that learn more about forgery-related features. Extensive visualizations and experiments demonstrate that our method can achieve competitive performance in general JPEG-resistant image forgery localization, especially in the performance of generalization experiments.
Authors
- Zuomin Qu (ORCID: https://orcid.org/0009-0008-9321-5065)
- Jiwu Huang (ORCID: https://orcid.org/0000-0002-7625-5689)
- Xiaochun Cao (ORCID: https://orcid.org/0000-0001-7141-708X)
- Ziqi Sheng
- Wei Lu (ORCID: https://orcid.org/0000-0002-4068-1766)
Institutions
- Sun Yat-sen University (CN)
- Shenzhen MSU-BIT University
Publication Details
- Journal
- IEEE Transactions on Dependable and Secure Computing
- Published
- 2024-12-25
- DOI
- https://doi.org/10.1109/tdsc.2024.3522190
- Citations
- 1
- Primary Topic
- Digital Media Forensic Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.25