Feature Augmentation via Dirichlet Mixup for Text-guided Diffusion Image Style Transfer

Image style transfer aims to generate an image that reflects a desired style while preserving the original content. Traditional image-guided methods rely on specific style reference images, limiting their versatility and sometimes compromising the quality of the results. In contrast, text-guided methods offer greater flexibility by allowing users to describe the target style through text prompts. However, these methods often face challenges in maintaining style consistency, accurately reflecting the described style, and preserving the content of the target image. To overcome these limitations, we introduce the Feature Augmentation via Dirichlet Mixup module into the style transfer process. Our method outperforms existing approaches, consistently achieving high-quality stylization while preserving the semantic content of the source image. Experimental results demonstrate the effectiveness of our method across a wide variety of source images and style prompts.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1145/3746709.3746717
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Feature Augmentation via Dirichlet Mixup for Text-guided Diffusion Image Style Transfer

Liheng Ruan, Bing Wang, Yuexing Han
Generative Adversarial Networks and Image Synthesis
article

Feature Augmentation via Dirichlet Mixup for Text-guided Diffusion Image Style Transfer

Liheng Ruan, Bing Wang, Yuexing Han
article en

Abstract

Image style transfer aims to generate an image that reflects a desired style while preserving the original content. Traditional image-guided methods rely on specific style reference images, limiting their versatility and sometimes compromising the quality of the results. In contrast, text-guided methods offer greater flexibility by allowing users to describe the target style through text prompts. However, these methods often face challenges in maintaining style consistency, accurately reflecting the described style, and preserving the content of the target image. To overcome these limitations, we introduce the Feature Augmentation via Dirichlet Mixup module into the style transfer process. Our method outperforms existing approaches, consistently achieving high-quality stylization while preserving the semantic content of the source image. Experimental results demonstrate the effectiveness of our method across a wide variety of source images and style prompts.

Shanghai University (CN), Shanghai University of Engineering Science (CN)
Openalex Percentile: Top 78%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.