Building a Chinese ancient architecture multimodal dataset combining image, annotation and style-model
In this rapidly evolving era of multimodal generation, diffusion models exhibit impressive generative capabilities, significantly enhancing the realm of creative image synthesis by intricately textual prompts. Yet, their effectiveness is limited in certain niche sectors, like depicting Chinese ancient architecture. This limitation is primarily due to the insufficient data that fails to encompass the unique architectural features and corresponding text information. Hence, we build an extensive multimodal dataset capturing the essence of Chinese architectures mostly from the Tang to the Yuan Dynasties. The dataset is categorized on the types, including image&text, video, and style models. In details, images and videos are methodically categorized based on locations. All images are annotated at two levels: initial annotations and descriptive terms based on distinctive characteristics and official information. Moreover, seven artistic styles fine-tuning models are provided in our dataset for further innovations. Significantly, this is the first Chinese ancient architecture dataset and the instance of using the Pinyin system to annotate unique terms related to Chinese architectural styles.
Authors
- Yunxi Yan
- Yong Shi (ORCID: https://orcid.org/0000-0003-2764-6621)
- LI He-min (ORCID: https://orcid.org/0009-0002-6130-0659)
- Kun Guo (ORCID: https://orcid.org/0000-0002-4787-8406)
- Yang Du (ORCID: https://orcid.org/0000-0003-3012-0778)
- Gang Kou (ORCID: https://orcid.org/0000-0002-9220-8647)
- Biao Li (ORCID: https://orcid.org/0000-0002-8952-1990)
- Jinyuan Feng
- Tie Li (ORCID: https://orcid.org/0000-0002-0851-2508)
- Yi Peng (ORCID: https://orcid.org/0000-0002-4893-6436)
- Xun Wang (ORCID: https://orcid.org/0000-0001-9545-7350)
Institutions
- Central South University (CN)
- University of Electronic Science and Technology of China (CN)
- Chinese Academy of Sciences (CN)
- Southwestern University of Finance and Economics (CN)
- Beijing Institute of Big Data Research (CN)
- Neusoft (China) (CN)
- University of Chinese Academy of Sciences (CN)
- Chengdu Neusoft University
Publication Details
- Journal
- Scientific Data
- Published
- 2024-10-16
- DOI
- https://doi.org/10.1038/s41597-024-03946-1
- Citations
- 7
- Primary Topic
- Remote Sensing and Land Use
- Type
- article
- Field-Weighted Citation Impact
- 2.63
Funders
- National Science Foundation
- National Natural Science Foundation of China
- National Social Science Fund of China