Transformer-based 3D pose estimation pipeline with modular SmoothNet integration for animation generation

Traditional 3D human pose estimation and animation generation methods still face high computational cost and temporal instability. To address these issues, this study develops a Transformer-based 3D pose estimation pipeline for spatial prediction and integrates SmoothNet as an external modular post-processing component for temporal smoothing. The backbone extracts image features with ResNet, encodes global dependencies using Transformer blocks, and outputs 3D keypoints for downstream reconstruction. SmoothNet is then applied to reduce frame-level jitter in predicted pose sequences. We evaluate the full pipeline on H3WB, AGORA, and AthletePose3D using MPJPE, PA-MPJPE, MPVE, and acceleration error. In addition, a fairness-controlled protocol on H3WB is introduced to compare MHFormer and the proposed backbone under unified SmoothNet post-processing settings, separating backbone effects from smoothing effects. Animation quality is further validated through Blender and Unreal Engine (UE) deployment.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-27
DOI
https://doi.org/10.1038/s41598-026-54621-x
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformer-based 3D pose estimation pipeline with modular SmoothNet integration for animation generation

Xinyi Xu
Scientific Reports
3D Shape Modeling and Analysis
article

Transformer-based 3D pose estimation pipeline with modular SmoothNet integration for animation generation

Xinyi Xu
article en

Abstract

Traditional 3D human pose estimation and animation generation methods still face high computational cost and temporal instability. To address these issues, this study develops a Transformer-based 3D pose estimation pipeline for spatial prediction and integrates SmoothNet as an external modular post-processing component for temporal smoothing. The backbone extracts image features with ResNet, encodes global dependencies using Transformer blocks, and outputs 3D keypoints for downstream reconstruction. SmoothNet is then applied to reduce frame-level jitter in predicted pose sequences. We evaluate the full pipeline on H3WB, AGORA, and AthletePose3D using MPJPE, PA-MPJPE, MPVE, and acceleration error. In addition, a fairness-controlled protocol on H3WB is introduced to compare MHFormer and the proposed backbone under unified SmoothNet post-processing settings, separating backbone effects from smoothing effects. Animation quality is further validated through Blender and Unreal Engine (UE) deployment.

Scientific Reports
Cheongju University (KR)
Openalex Percentile: Top 6%
3D Shape Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.