Region-guided Latent Diffusion for Training-free Style Transfer

Training-free diffusion methods show promise in style transfer but often suffer from spatial distortion and style-content leakage due to the lack of explicit structure guidance and spatial control. To address these limitations, we propose a region-guided dual-path diffusion framework that incorporates multi-level structural and positional priors to improve content preservation and controllability. First, we introduce a structural and positional image manipulation (SPIM) module that generates control maps via ControlNet for unified resizing, structure alignment, and mask-based region control. To better balance regional stylization and texture fidelity, we design a latent feature enhancement and normalization module (LaFEN) that adaptively injects high-frequency style residuals into the content latent space. Furthermore, we propose a region-aware and step-adaptive QKV fusion strategy to enhance the flexibility and precision of feature mixing across the denoising process. Extensive experiments show that our method consistently achieves high-quality stylization and structural fidelity in the style transfer stage without any additional training.

Authors

Institutions

Publication Details

Published
2025-07-11
DOI
https://doi.org/10.1109/cisat66811.2025.11181740
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Region-guided Latent Diffusion for Training-free Style Transfer

Songtao Liu, Ruilin Zhang, Yang Zhao, Yongsheng Dong
Natural Language Processing Techniques
article

Region-guided Latent Diffusion for Training-free Style Transfer

Songtao Liu, Ruilin Zhang, Yang Zhao, Yongsheng Dong
article en

Abstract

Training-free diffusion methods show promise in style transfer but often suffer from spatial distortion and style-content leakage due to the lack of explicit structure guidance and spatial control. To address these limitations, we propose a region-guided dual-path diffusion framework that incorporates multi-level structural and positional priors to improve content preservation and controllability. First, we introduce a structural and positional image manipulation (SPIM) module that generates control maps via ControlNet for unified resizing, structure alignment, and mask-based region control. To better balance regional stylization and texture fidelity, we design a latent feature enhancement and normalization module (LaFEN) that adaptively injects high-frequency style residuals into the content latent space. Furthermore, we propose a region-aware and step-adaptive QKV fusion strategy to enhance the flexibility and precision of feature mixing across the denoising process. Extensive experiments show that our method consistently achieves high-quality stylization and structural fidelity in the style transfer stage without any additional training.

Henan University of Science and Technology (CN)
Openalex Percentile: Top 86%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.