Multi-Scale Optimal Transport Transformer for Efficient Exemplar-Based Image Translation
Exemplar-based image translation generates an output image by transferring appearance from a reference exemplar to a content image. Existing works only consider the local correspondences between two modalities, and ignore the global distributions in each modality, struggling to obtain fine-grained details with efficient computation. In this paper, we propose OTFormer, a multi-scale Optimal Transport transformer for exemplarbased image translation. We formulate cross-modal alignment as a multi-scale optimal transport problem, which progressively provides a globally coherent matching. In addition, we design a lightweight multi-scale fusion block to extract and fuse features efficiently. Experiments on CelebA-HQ and DeepFashion demonstrate that OTFormer improves both image fidelity and style adherence, while reducing model parameters by 62% and achieving faster inference compared with strong baselines. These results highlight OTguided global alignment as an effective and deployable solution for high-fidelity exemplarbased image translation.
Authors
- Yuqin Lin (ORCID: https://orcid.org/0000-0003-4842-9263)
- Xiongzheng Li
Institutions
- Alibaba Group (China) (CN)
- Fuzhou University (CN)
Publication Details
- Journal
- Big Data and Cognitive Computing
- Published
- 2026-04-01
- DOI
- https://doi.org/10.3390/bdcc10040107
- Primary Topic
- Generative Adversarial Networks and Image Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00