3D Mesh Generation Model of Human Body Based on Monocular Image and 2D Pose

In this paper, we propose a model designed to generate a single human 3D mesh from monocular images and 2D human poses, even in highly occluded environments. The model employs a well-established 2D pose detector to capture the 2D pose information of the human body. Additionally, our proposed AFF module extracts robust features in occluded conditions. The model's regressor, leveraging both 2D and 3D joint features, allows it to focus on the target person's positional region while estimating depth information to distinguish the person from other objects. Ultimately, the model regresses the parameters of a parametric human body model. We validate the proposed method on public benchmark datasets, which qualitatively and quantitatively demonstrate its robustness in recovering 3D human body meshes in occluded environments.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/cac63892.2024.10865436
Primary Topic
Simulation and Modeling Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

3D Mesh Generation Model of Human Body Based on Monocular Image and 2D Pose

Xiaojian Yi, Yong Li
Simulation and Modeling Applications
article

3D Mesh Generation Model of Human Body Based on Monocular Image and 2D Pose

Xiaojian Yi, Yong Li
article en

Abstract

In this paper, we propose a model designed to generate a single human 3D mesh from monocular images and 2D human poses, even in highly occluded environments. The model employs a well-established 2D pose detector to capture the 2D pose information of the human body. Additionally, our proposed AFF module extracts robust features in occluded conditions. The model's regressor, leveraging both 2D and 3D joint features, allows it to focus on the target person's positional region while estimating depth information to distinguish the person from other objects. Ultimately, the model regresses the parameters of a parametric human body model. We validate the proposed method on public benchmark datasets, which qualitatively and quantitatively demonstrate its robustness in recovering 3D human body meshes in occluded environments.

Chongqing University of Posts and Telecommunications (CN)
Gender equality
Openalex Percentile: Top 67%
Simulation and Modeling Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

3D Mesh Generation Model of Human Body Based on Monocular Image and 2D Pose — Xiaojian Yi, Yong Li · (2024) | TGRS Research Map | TGRS