Improving aesthetic pattern-aware style transfer networks with Sharpness-Aware Minimization

Artistic style transfer aims to repaint the content image with the learned artistic style. Despite notable progress achieved by convolutional neural network (CNN)-based methods, existing approaches often suffer from complex loss landscapes and limited generalization, particularly under data-scarce settings. To address these challenges, we propose a novel style transfer framework that explicitly integrates domain adaptation principles with Sharpness-Aware Minimization (SAM). Unlike previous methods, our approach aligns high-dimensional feature representations between content and style domains to preserve semantic structure, while enabling flexible stylistic transformations through controlled texture and appearance modulation in lower-dimensional spaces. Furthermore, SAM is employed to smooth the optimization landscape, leading to more stable training dynamics and improved generalization. Extensive experiments conducted on the WikiArt and DIV2k datasets show that the proposed method consistently outperforms state-of-the-art techniques, achieving a 0.0286 improvement over Cascade Style Transfer (CST) in the CLIP Score metric, while producing visually clearer and more coherent stylized results. Notably, our framework shows strong advantages in small-sample style transfer scenarios, where traditional methods typically degrade. These results indicate that the proposed method provides a robust and efficient solution for artistic style transfer with enhanced stability and generalization.

Authors

Publication Details

Journal
PeerJ Computer Science
Published
2026-03-23
DOI
https://doi.org/10.7717/peerj-cs.3720
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving aesthetic pattern-aware style transfer networks with Sharpness-Aware Minimization

Jinguang Lv, Nali Liu
PeerJ Computer Science
Generative Adversarial Networks and Image Synthesis
article

Improving aesthetic pattern-aware style transfer networks with Sharpness-Aware Minimization

Jinguang Lv, Nali Liu
article en

Abstract

Artistic style transfer aims to repaint the content image with the learned artistic style. Despite notable progress achieved by convolutional neural network (CNN)-based methods, existing approaches often suffer from complex loss landscapes and limited generalization, particularly under data-scarce settings. To address these challenges, we propose a novel style transfer framework that explicitly integrates domain adaptation principles with Sharpness-Aware Minimization (SAM). Unlike previous methods, our approach aligns high-dimensional feature representations between content and style domains to preserve semantic structure, while enabling flexible stylistic transformations through controlled texture and appearance modulation in lower-dimensional spaces. Furthermore, SAM is employed to smooth the optimization landscape, leading to more stable training dynamics and improved generalization. Extensive experiments conducted on the WikiArt and DIV2k datasets show that the proposed method consistently outperforms state-of-the-art techniques, achieving a 0.0286 improvement over Cascade Style Transfer (CST) in the CLIP Score metric, while producing visually clearer and more coherent stylized results. Notably, our framework shows strong advantages in small-sample style transfer scenarios, where traditional methods typically degrade. These results indicate that the proposed method provides a robust and efficient solution for artistic style transfer with enhanced stability and generalization.

PeerJ Computer ScienceVol. 12
Sustainable cities and communities
Openalex Percentile: Top 11%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.