Building a Chinese ancient architecture multimodal dataset combining image, annotation and style-model

In this rapidly evolving era of multimodal generation, diffusion models exhibit impressive generative capabilities, significantly enhancing the realm of creative image synthesis by intricately textual prompts. Yet, their effectiveness is limited in certain niche sectors, like depicting Chinese ancient architecture. This limitation is primarily due to the insufficient data that fails to encompass the unique architectural features and corresponding text information. Hence, we build an extensive multimodal dataset capturing the essence of Chinese architectures mostly from the Tang to the Yuan Dynasties. The dataset is categorized on the types, including image&text, video, and style models. In details, images and videos are methodically categorized based on locations. All images are annotated at two levels: initial annotations and descriptive terms based on distinctive characteristics and official information. Moreover, seven artistic styles fine-tuning models are provided in our dataset for further innovations. Significantly, this is the first Chinese ancient architecture dataset and the instance of using the Pinyin system to annotate unique terms related to Chinese architectural styles.

Authors

Institutions

Publication Details

Journal
Scientific Data
Published
2024-10-16
DOI
https://doi.org/10.1038/s41597-024-03946-1
Citations
7
Primary Topic
Remote Sensing and Land Use
Type
article
Field-Weighted Citation Impact
2.63

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Building a Chinese ancient architecture multimodal dataset combining image, annotation and style-model

Yunxi Yan, Yong Shi, LI He-min, Kun Guo et al.
7 citations
Scientific Data
Remote Sensing and Land Use
2.63
article

Building a Chinese ancient architecture multimodal dataset combining image, annotation and style-model

Yunxi Yan, Yong Shi, LI He-min, Kun Guo, Yang Du, Gang Kou, Biao Li, Jinyuan Feng, Tie Li, Yi Peng, Xun Wang
article en
7 citations

Abstract

In this rapidly evolving era of multimodal generation, diffusion models exhibit impressive generative capabilities, significantly enhancing the realm of creative image synthesis by intricately textual prompts. Yet, their effectiveness is limited in certain niche sectors, like depicting Chinese ancient architecture. This limitation is primarily due to the insufficient data that fails to encompass the unique architectural features and corresponding text information. Hence, we build an extensive multimodal dataset capturing the essence of Chinese architectures mostly from the Tang to the Yuan Dynasties. The dataset is categorized on the types, including image&text, video, and style models. In details, images and videos are methodically categorized based on locations. All images are annotated at two levels: initial annotations and descriptive terms based on distinctive characteristics and official information. Moreover, seven artistic styles fine-tuning models are provided in our dataset for further innovations. Significantly, this is the first Chinese ancient architecture dataset and the instance of using the Pinyin system to annotate unique terms related to Chinese architectural styles.

Scientific DataVol. 11(1)
Central South University (CN), University of Electronic Science and Technology of China (CN), Chinese Academy of Sciences (CN), Southwestern University of Finance and Economics (CN), Beijing Institute of Big Data Research (CN), Neusoft (China) (CN), University of Chinese Academy of Sciences (CN), Chengdu Neusoft University
National Science Foundation, National Natural Science Foundation of China, National Social Science Fund of China
Sustainable cities and communities
Openalex Percentile: Top 10%
Remote Sensing and Land Use
2.63
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.