MMED: a Mamba-enhanced multi-scale diffusion model for efficient thangka image generation
Text-to-image generation for Thangka artwork requires high-resolution synthesis and precise semantic–spatial alignment. However, existing diffusion models suffer from high computational overhead and struggle with spatial reasoning at scale. This paper introduces MMED, a Mamba-enhanced multi-scale diffusion framework for efficient Thangka generation. First, the Mamba Spatial Mixer (MSM) replaces quadratic self-attention with adaptive sparse grid-scanning, achieving near-linear complexity while capturing long-range dependencies. Second, the Dual-Stream Gated Mamba Cross-Attention (DSG-MCA) module couples textual instructions with positional encodings for fine-grained semantic-spatial precision. Third, the Adaptive Parallel Mamba Residual (APMR) block integrates convolution with state-space dynamics to improve feature propagation and training stability. Experiments on a curated Thangka dataset show MMED reduces training time by 35% and inference latency by 60%, while achieving 16% FID improvement and 31% IS increase over strong baselines. Superior performance on the CUB dataset validates the generalization capability, offering a new perspective for efficient cultural heritage generation.
Authors
- Gongwei Chen (ORCID: https://orcid.org/0000-0002-0634-6075)
- Wenjin Hu
Institutions
- Minzu University of China (CN)
- Gansu Institute of Political Science and Law (CN)
Publication Details
- Journal
- npj Heritage Science
- Published
- 2026-06-27
- DOI
- https://doi.org/10.1038/s40494-026-02777-0
- Primary Topic
- Medical Image Segmentation Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China