Efficient Image Harmonization via RGB Transformation
Image harmonization aims to adjust the appearance of the foreground to make it harmonious with the background, thereby maintaining visual consistency in composite images. Previous deep learning-based methods have mainly focused on reconstructing harmonized images with the same size as the input composite images, often leading to complex network structures and a large number of parameters. In this paper, we propose a simple yet effective lightweight image harmonization network architecture. First, we generate a low-resolution 3-channel feature map to represent the rough variations in the RGB channels of a composite image, which is then upsampled and added to this composite image to obtain a preliminary harmonization result. Then, a refinement module is applied to refine the preliminary result and output the final harmonized image. Additionally, we design a dynamic data generation and training strategy to pre-train our model on another dataset. Experimental results on the iHarmony4 dataset show that our method indicates a significant reduction in the number of parameters compared to other methods, yet it still achieved competitive performance.
Authors
- Jinhui Wang (ORCID: https://orcid.org/0000-0003-4731-8481)
- Cheng Su (ORCID: https://orcid.org/0009-0003-3281-7904)
- Wenbo Wan (ORCID: https://orcid.org/0000-0003-1447-0524)
- Jiande Sun (ORCID: https://orcid.org/0000-0001-6157-2051)
- Jian Wang
- Kai Zhang (ORCID: https://orcid.org/0000-0001-6818-377X)
Institutions
- Shandong Normal University (CN)
Publication Details
- Published
- 2024-10-02
- DOI
- https://doi.org/10.1109/mmsp61759.2024.10743257
- Primary Topic
- Image and Signal Denoising Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00