Adaptive Spatial-Temporal Modelling For Human Motion Prediction
Human motion prediction is the process of predicting future motion sequences based on past motion sequences. The graph convolution methods currently used for modelling human motion are effective in capturing the interrelationships between joints. However, these works lack skeleton constraints on the learning of graph filters, and DCT-based temporal modeling methods produce overly smooth motion representations and ignore the learning of human motion details. In this paper, we propose a network that uses adaptive spatial graph convolution and temporal self-attention to improve human motion prediction. The adaptive graph convolution effectively enhances cross-scale spatial interaction of joint movements based on different motion patterns. Meanwhile, temporal self-attention, combined with historical motion attention, improves the learning of motion temporal information. Our proposed network achieved state-of-the-art performance on two benchmark datasets, as demonstrated by extensive experiments.
Authors
- Huiyu Zhou (ORCID: https://orcid.org/0000-0003-1634-9840)
- Jianhua Zhang (ORCID: https://orcid.org/0000-0002-3819-2437)
- Na Lv (ORCID: https://orcid.org/0000-0002-8890-1393)
Institutions
- University of Leicester (GB)
- University of Jinan (CN)
Publication Details
- Published
- 2024-09-27
- DOI
- https://doi.org/10.1109/icip51287.2024.10647320
- Citations
- 1
- Primary Topic
- Human Pose and Action Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.25