Motion Diffusion Model for Long Motion Generation

Long-term human movement prediction has become a key research focus, driven by its numerous applications in domain such as robotics, virtual reality, video analysis. Traditional methodologies, primarily based on artificial modeling, often unable capture the complicated dynamics of human movement. Recent developments have explored recurrent neural networks and generative models for sequence prediction, but challenges persist in achieving accurate and realistic long-term predictions. This study introduces a deep generative motion infiller leveraging a diffusion model, capable of seamlessly generating motion sequences of arbitrary length from historical or sparsely available key-frames. This model adeptly addresses the complexities of filling in missing or occluded body movements by utilizing observed motion data and predicting new sequences. The proposed method incorporates a Transformer-based structure optimized for lightweight operation, which is employed within a sliding window framework to establish a recurrent generation system. Additionally, a novel method is proposed for style transfer, applicable during inference, enhancing the diversity and the resulting sense of motion. The proposed model also demonstrates effectiveness in generating short-term and long predictions, comprehensive evaluations indicate that the proposed approach yields more diverse and realistic motion predictions compared to existing methods, we evaluated the model in indicate of global and local diversity, which have the better result.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/icmlca63499.2024.10754164
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Motion Diffusion Model for Long Motion Generation

Xiangyu Han, Xu Hu, Huawei Sun
Advanced Vision and Imaging
article

Motion Diffusion Model for Long Motion Generation

Xiangyu Han, Xu Hu, Huawei Sun
article en

Abstract

Long-term human movement prediction has become a key research focus, driven by its numerous applications in domain such as robotics, virtual reality, video analysis. Traditional methodologies, primarily based on artificial modeling, often unable capture the complicated dynamics of human movement. Recent developments have explored recurrent neural networks and generative models for sequence prediction, but challenges persist in achieving accurate and realistic long-term predictions. This study introduces a deep generative motion infiller leveraging a diffusion model, capable of seamlessly generating motion sequences of arbitrary length from historical or sparsely available key-frames. This model adeptly addresses the complexities of filling in missing or occluded body movements by utilizing observed motion data and predicting new sequences. The proposed method incorporates a Transformer-based structure optimized for lightweight operation, which is employed within a sliding window framework to establish a recurrent generation system. Additionally, a novel method is proposed for style transfer, applicable during inference, enhancing the diversity and the resulting sense of motion. The proposed model also demonstrates effectiveness in generating short-term and long predictions, comprehensive evaluations indicate that the proposed approach yields more diverse and realistic motion predictions compared to existing methods, we evaluated the model in indicate of global and local diversity, which have the better result.

Tongji University (CN)
Openalex Percentile: Top 79%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Motion Diffusion Model for Long Motion Generation — Xiangyu Han, Xu Hu, et al. · (2024) | TGRS Research Map | TGRS