Image style transfer based on improved detail retaining
In this paper, the detail-retaining plug-in (DRP) connects the shallow features output from the encoder, and makes the shallow features participate in the attention computation through the divide-and-conquer mechanism, the slicer firstly slices the shallow features into a number of sub-features losslessly, and then feeds them into the style transformation module, so that the shallow features attend in the attention computing the style transformation with a small amount of computation cost; In the style transformation module, the mean and standard deviation of the content features are adjusted to align with the mean and standard deviation of the attention-weighted stylized features, and the stylized features are output; then the shallow stylized features are reconstructed back to the original dimensions by the splicer; finally, the reconstructed shallow stylized features are sent to the decoder along with the deeper stylized features, and the decoded outputs are obtained to obtain the final detail-enhanced stylized images. The significance and generality of the algorithms and plugins proposed in this paper are verified through the comparison and analysis of relevant experimental data and SOTA methods.
Authors
- Qiao Jiang (ORCID: https://orcid.org/0000-0002-5909-8343)
- Tian‐Wei Song (ORCID: https://orcid.org/0000-0002-6105-9183)
- Hongbo Zhang (ORCID: https://orcid.org/0000-0003-2047-2323)
- Wenqiang Zhang (ORCID: https://orcid.org/0000-0002-2245-8085)
- Qingyun Xu (ORCID: https://orcid.org/0000-0001-7733-3813)
- Yujie Zhou (ORCID: https://orcid.org/0000-0002-9545-1984)
Institutions
- Northwestern Polytechnical University (CN)
- Nanyang Technological University (SG)
- Hainan University (CN)
- Guizhou Electromechanical Research and Design Institute (CN)
- East China Normal University (CN)
Publication Details
- Published
- 2025-05-28
- DOI
- https://doi.org/10.1117/12.3067670
- Primary Topic
- Image Enhancement Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00