TST-Attention: A Diffusion-Based Approach for Human Motion Prediction

Human motion prediction(HMP), a crucial problem in human-computer interaction, will significantly impact our lives in the future. Current research still fails to provide precisely enough and detailed predictions of future motion based on observed sequences. To address the issue, we propose an innovative method that sequentially adds spatial and time-step attention modules to the posture prediction task, which usually focused only on temporal dependencies. The model combines spatial-temporal dependencies and time-step information with posture sequences, aiming to enhance the accuracy and fidelity of stochastic predictions. Our model utilizes a diffusion process with a transformer backbone and incorporates a squeeze-and-excitation module to calibrate the influence of each time step in the posture sequence, enhancing prediction performance, Improving the model's adaptability to varying levels of channel feature importance. We evaluate our approach on the two benchmark datasets, demonstrating state-of-the-art performance. Notably, our model is lightweight, with a reduced number of parameters.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/itnec60942.2024.10733294
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TST-Attention: A Diffusion-Based Approach for Human Motion Prediction

Yang Shu, Xiangrong Fu, Liya Tian, Binzi Wang
Human Pose and Action Recognition
article

TST-Attention: A Diffusion-Based Approach for Human Motion Prediction

Yang Shu, Xiangrong Fu, Liya Tian, Binzi Wang
article en

Abstract

Human motion prediction(HMP), a crucial problem in human-computer interaction, will significantly impact our lives in the future. Current research still fails to provide precisely enough and detailed predictions of future motion based on observed sequences. To address the issue, we propose an innovative method that sequentially adds spatial and time-step attention modules to the posture prediction task, which usually focused only on temporal dependencies. The model combines spatial-temporal dependencies and time-step information with posture sequences, aiming to enhance the accuracy and fidelity of stochastic predictions. Our model utilizes a diffusion process with a transformer backbone and incorporates a squeeze-and-excitation module to calibrate the influence of each time step in the posture sequence, enhancing prediction performance, Improving the model's adaptability to varying levels of channel feature importance. We evaluate our approach on the two benchmark datasets, demonstrating state-of-the-art performance. Notably, our model is lightweight, with a reduced number of parameters.

Shanghai Open University (CN)
Climate action
Openalex Percentile: Top 81%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

TST-Attention: A Diffusion-Based Approach for Human Motion Prediction — Yang Shu, Xiangrong Fu, et al. · (2024) | TGRS Research Map | TGRS