Cross-modal style transfer guided by fine-grained text based on capsule network

This paper proposes a fine-grained text-guided cross-modal style transfer framework based on capsule networks, addressing the shortcomings of existing methods in multi-modal feature alignment, style decoupling, and fine-grained control. Firstly, a text-image collaborative encoder is constructed, using the dynamic routing capsule network to encode text attributes into a set of interpretable style-content capsules, achieving explicit separation of style and content. Secondly, a cross-modal attention style injection module is designed, using the routing coefficients between capsules to precisely map text style information to the image content representation, supporting fine-grained adjustment of local attributes such as color, texture, and brushstrokes. Finally, contrastive learning constraints are introduced to ensure consistency and authenticity of style transfer. Empirical results on public benchmarks demonstrate that the proposed approach achieves markedly better style controllability, content preservation, and visual fidelity than state-of-the-art competitors, opening a novel avenue for steerable cross-modal generation.

Institutions

Publication Details

Journal
SHILAP Revista de lepidopterología
Published
2025-10-01
DOI
https://doi.org/10.6180/jase.202605_29(5).0009
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-modal style transfer guided by fine-grained text based on capsule network

SHILAP Revista de lepidopterología
Generative Adversarial Networks and Image Synthesis
article

Cross-modal style transfer guided by fine-grained text based on capsule network

article en

Abstract

This paper proposes a fine-grained text-guided cross-modal style transfer framework based on capsule networks, addressing the shortcomings of existing methods in multi-modal feature alignment, style decoupling, and fine-grained control. Firstly, a text-image collaborative encoder is constructed, using the dynamic routing capsule network to encode text attributes into a set of interpretable style-content capsules, achieving explicit separation of style and content. Secondly, a cross-modal attention style injection module is designed, using the routing coefficients between capsules to precisely map text style information to the image content representation, supporting fine-grained adjustment of local attributes such as color, texture, and brushstrokes. Finally, contrastive learning constraints are introduced to ensure consistency and authenticity of style transfer. Empirical results on public benchmarks demonstrate that the proposed approach achieves markedly better style controllability, content preservation, and visual fidelity than state-of-the-art competitors, opening a novel avenue for steerable cross-modal generation.

SHILAP Revista de lepidopterología
Zhengzhou University of Science and Technology (CN)
Sustainable cities and communities
Openalex Percentile: Top 43%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Cross-modal style transfer guided by fine-grained text based on capsule network · SHILAP Revista de lepidopterología (2025) | TGRS Research Map | TGRS