3D Human Pose Construction Algorithm Based on 2D Node to 3D Model

This paper proposes an efficient method for converting 2D video images into 3D human poses based on deep learning and 3D model fitting. This algorithm extracts the key points by using a 2D pose estimation model and enhances the reliability of the estimation by using a confidence evaluation mechanism. For multi-human scenarios, this algorithm adopts the key point clustering technique to achieve the association of the individuals. The 2D key points are then mapped into 3D space using the SMPL model. The reconstruction accuracy is optimised using a deviation function. Finally, the 3D skeleton is normalised to improve the consistency of the results. The experimental results show that the method significantly improves the conversion accuracy and robustness with some practicality, and is able to accurately capture the character's movements while quickly constructing the 3D skeleton.

Authors

Institutions

Publication Details

Published
2024-08-16
DOI
https://doi.org/10.1109/docs63458.2024.10704476
Primary Topic
Simulation and Modeling Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

3D Human Pose Construction Algorithm Based on 2D Node to 3D Model

Weichuan Ni, Meixia Dong, Hongjuan He
Simulation and Modeling Applications
article

3D Human Pose Construction Algorithm Based on 2D Node to 3D Model

Weichuan Ni, Meixia Dong, Hongjuan He
article en

Abstract

This paper proposes an efficient method for converting 2D video images into 3D human poses based on deep learning and 3D model fitting. This algorithm extracts the key points by using a 2D pose estimation model and enhances the reliability of the estimation by using a confidence evaluation mechanism. For multi-human scenarios, this algorithm adopts the key point clustering technique to achieve the association of the individuals. The 2D key points are then mapped into 3D space using the SMPL model. The reconstruction accuracy is optimised using a deviation function. Finally, the 3D skeleton is normalised to improve the consistency of the results. The experimental results show that the method significantly improves the conversion accuracy and robustness with some practicality, and is able to accurately capture the character's movements while quickly constructing the 3D skeleton.

Anhui Xinhua University (CN), Guangzhou Xinhua University
Sustainable cities and communities
Openalex Percentile: Top 80%
Simulation and Modeling Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.