Chang-E: A High-Quality Motion Capture Dataset of Chinese Classical Dunhuang Dance

Derived from the mural drawings in the UNESCO-listed Mogao Caves, Dunhuang dance has unique cultural value but faces challenges of digitization and preservation. In this article, we introduce the first open comprehensive motion capture dataset of Dunhuang dance, Chang-E , including full-body movements documented across 8 categories, totaling 40 minutes of professional dance (preview available at https://cislab.hkust-gz.edu.cn/projects/chang-e/ ). This dataset contains three formats: skeleton data acquired from motion capture, body mesh generated from skeleton using machine learning, and multiview videos recorded on site. The dataset supports various creative applications for Dunhuang dance culture, as demonstrated by an immersive new media exhibition. Through the curation process, we applied motion inbetweening algorithms to concatenate different dance sequences for choreography. Also, these reinterpreted dance sequences are synchronized with music using retiming techniques, augmenting the rhythms and harmony between the music and dance performance. Furthermore, we applied visual effects on the regenerated motion sequences of digital dancers, achieving artistic and appealing visual results echoing Buddhist discourses of meditation and bodily cognition. The Chang-E dataset enables digital preservation and creative reimagination of Dunhuang dance, offering not only high-quality data but also an interdisciplinary collaboration framework for future graphics and cultural heritage research.

Authors

Institutions

Publication Details

Journal
Journal on Computing and Cultural Heritage
Published
2024-12-19
DOI
https://doi.org/10.1145/3709000
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Chang-E: A High-Quality Motion Capture Dataset of Chinese Classical Dunhuang Dance

A. Y. Shen, Yingke Wang, Borou Yu, Zhe Yan et al.
1 links
Journal on Computing and Cultural Heritage
Human Pose and Action Recognition
article

Chang-E: A High-Quality Motion Capture Dataset of Chinese Classical Dunhuang Dance

A. Y. Shen, Yingke Wang, Borou Yu, Zhe Yan, Jiashun Wang, Huazhe Xu, Chengan He, Holly Rushmeier, E. Wang, Mengying Zeng, Zeyu Wang, Junhua Liu, Chenchen Lu
article en

Abstract

Derived from the mural drawings in the UNESCO-listed Mogao Caves, Dunhuang dance has unique cultural value but faces challenges of digitization and preservation. In this article, we introduce the first open comprehensive motion capture dataset of Dunhuang dance, Chang-E , including full-body movements documented across 8 categories, totaling 40 minutes of professional dance (preview available at https://cislab.hkust-gz.edu.cn/projects/chang-e/ ). This dataset contains three formats: skeleton data acquired from motion capture, body mesh generated from skeleton using machine learning, and multiview videos recorded on site. The dataset supports various creative applications for Dunhuang dance culture, as demonstrated by an immersive new media exhibition. Through the curation process, we applied motion inbetweening algorithms to concatenate different dance sequences for choreography. Also, these reinterpreted dance sequences are synchronized with music using retiming techniques, augmenting the rhythms and harmony between the music and dance performance. Furthermore, we applied visual effects on the regenerated motion sequences of digital dancers, achieving artistic and appealing visual results echoing Buddhist discourses of meditation and bodily cognition. The Chang-E dataset enables digital preservation and creative reimagination of Dunhuang dance, offering not only high-quality data but also an interdisciplinary collaboration framework for future graphics and cultural heritage research.

Journal on Computing and Cultural HeritageVol. 19(1)
Northeastern University (US), Harvard University Press (US), Yale University (US), Chinese University of Hong Kong, Shenzhen (CN), Carnegie Mellon University (US), Stanford University (US), Tsinghua University (CN)
Openalex Percentile: Top 77%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.