SPH-DiffDance: Semantic Prototype Reconstruction and Hypergraph-Enhanced Diffusion Framework for Long-Sequence Music-Driven Dance Generation

Abstract Long-sequence music-driven dance generation remains a challenging task, as existing methods still struggle with unstable global choreography semantics, insufficient local pose coordination, and difficulty in preserving complex motion details. Aiming to address these issues, we propose a Semantic Prototype Reconstruction and Hypergraph-Enhanced Diffusion Framework for Long-Sequence Music-Driven Dance Generation (SPH-DiffDance), refining motion from global semantic structure to local pose details. SPH-DiffDance follows a coarse-to fine diffusion framework, designing a Semantic Prototype Reconstruction (SPR) module at the coarse stage to provide semantic guidance for motion generation through constructing a learnable global dance prototype library. The motion latent features are queried and reconstructed, transforming continuous motion representations into prototype representations with semantic constraints. This process enhances the thematic consistency and long-range choreography stability of generated dances. Building upon established global semantics, a Hypergraph-Enhanced Pose Refinement (HEPR) module further improves local motion quality by modeling high-order motion correlations among the trunk, limbs, and feet through hyperedges. Compared with conventional skeleton graphs that mainly describe pairwise joint connections, the hypergraph structure provides richer representations of complex human motion relationships and improves pose coordination and structural rationality. Foot-contact constraints are also incorporated to refine local motion details and reduce foot sliding and abnormal poses. Experiments on the AIST++ music-driven dance generation dataset demonstrate that SPH-DiffDance can generate long-sequence 3D dances with good musical synchronization, motion continuity, and structural consistency.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-06
DOI
https://doi.org/10.21203/rs.3.rs-10936613/v1
Primary Topic
Human Motion and Animation
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

SPH-DiffDance: Semantic Prototype Reconstruction and Hypergraph-Enhanced Diffusion Framework for Long-Sequence Music-Driven Dance Generation

Chuanxin Xu, Zhengping Hu, Yifan Wu, Xingyu Li
2 links
Research Square
Human Motion and Animation
preprint

SPH-DiffDance: Semantic Prototype Reconstruction and Hypergraph-Enhanced Diffusion Framework for Long-Sequence Music-Driven Dance Generation

Chuanxin Xu, Zhengping Hu, Yifan Wu, Xingyu Li
preprint en

Abstract

Abstract Long-sequence music-driven dance generation remains a challenging task, as existing methods still struggle with unstable global choreography semantics, insufficient local pose coordination, and difficulty in preserving complex motion details. Aiming to address these issues, we propose a Semantic Prototype Reconstruction and Hypergraph-Enhanced Diffusion Framework for Long-Sequence Music-Driven Dance Generation (SPH-DiffDance), refining motion from global semantic structure to local pose details. SPH-DiffDance follows a coarse-to fine diffusion framework, designing a Semantic Prototype Reconstruction (SPR) module at the coarse stage to provide semantic guidance for motion generation through constructing a learnable global dance prototype library. The motion latent features are queried and reconstructed, transforming continuous motion representations into prototype representations with semantic constraints. This process enhances the thematic consistency and long-range choreography stability of generated dances. Building upon established global semantics, a Hypergraph-Enhanced Pose Refinement (HEPR) module further improves local motion quality by modeling high-order motion correlations among the trunk, limbs, and feet through hyperedges. Compared with conventional skeleton graphs that mainly describe pairwise joint connections, the hypergraph structure provides richer representations of complex human motion relationships and improves pose coordination and structural rationality. Foot-contact constraints are also incorporated to refine local motion details and reduce foot sliding and abnormal poses. Experiments on the AIST++ music-driven dance generation dataset demonstrate that SPH-DiffDance can generate long-sequence 3D dances with good musical synchronization, motion continuity, and structural consistency.

Research Square
Yanshan University (CN)
National Natural Science Foundation of China, Natural Science Foundation of Hebei Province
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon