Virtual restoration method of Kizil Grotto murals based on multimodal controlled diffusion models

Generative deep learning provides new approaches for natural image restoration and structural reconstruction. However, virtually restoring Kizil cave murals remains difficult due to their unique artistic style, complex damage, and the need to preserve semantic consistency. This study proposes a multimodal controlled diffusion model that integrates textual and multi-dimensional visual features for high-precision restoration. The model leverages latent space diffusion for high-quality image generation and introduces structural constraints to improve semantic alignment and controllability. A dynamic feature-adaptive GSC (DFA-GSC) module captures local and global features through multi-scale convolution and an adaptive weight generator, enhancing texture perception. For damaged regions, a conditional matching loss helps refine both texture and structure. Experimental results demonstrate that compared to traditional CNNs and single diffusion models, the proposed method achieves superior performance in both evaluation metrics and visual quality.

Authors

Institutions

Publication Details

Journal
npj Heritage Science
Published
2025-10-31
DOI
https://doi.org/10.1038/s40494-025-01981-8
Citations
2
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
2.55
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Virtual restoration method of Kizil Grotto murals based on multimodal controlled diffusion models

Ke Wang, Huiqin Wang, Li Zhao, Hang Zhao et al.
2 citations
npj Heritage Science
Generative Adversarial Networks and Image Synthesis
2.55
article

Virtual restoration method of Kizil Grotto murals based on multimodal controlled diffusion models

Ke Wang, Huiqin Wang, Li Zhao, Hang Zhao, Гуань-гынь Лв
article en
2 citations

Abstract

Generative deep learning provides new approaches for natural image restoration and structural reconstruction. However, virtually restoring Kizil cave murals remains difficult due to their unique artistic style, complex damage, and the need to preserve semantic consistency. This study proposes a multimodal controlled diffusion model that integrates textual and multi-dimensional visual features for high-precision restoration. The model leverages latent space diffusion for high-quality image generation and introduces structural constraints to improve semantic alignment and controllability. A dynamic feature-adaptive GSC (DFA-GSC) module captures local and global features through multi-scale convolution and an adaptive weight generator, enhancing texture perception. For damaged regions, a conditional matching loss helps refine both texture and structure. Experimental results demonstrate that compared to traditional CNNs and single diffusion models, the proposed method achieves superior performance in both evaluation metrics and visual quality.

npj Heritage ScienceVol. 13(1)
Xi'an University of Architecture and Technology (CN), Xinjiang Uygur Autonomous Region Product Quality Supervision and Inspection Institute (CN)
Openalex Percentile: Top 8%
Generative Adversarial Networks and Image Synthesis
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.