Unsupervised pose adaptation based 3D face reconstruction algorithm

We propose an unsupervised learning method to accurately reconstruct 3D shapes from single-view images without relying on externally supervised signals or a priori shape models. Our innovative approach generates new images and depth maps of different angles by performing pose transformations on top of existing data, with a particular focus on image reconstruction in extreme poses. By using these newly generated images and depth maps as training samples, we re-input the model and optimize it using the generated predictive depth maps. Experimental results show that the proposed method has excellent performance in the task of 3D reconstruction of faces from single-view images, especially in extreme poses, which is significantly better than traditional methods.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1145/3723420.3723435
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unsupervised pose adaptation based 3D face reconstruction algorithm

Sifan Cao, YU Zheng-sheng, Xiaodong Li
Face recognition and analysis
article

Unsupervised pose adaptation based 3D face reconstruction algorithm

Sifan Cao, YU Zheng-sheng, Xiaodong Li
article en

Abstract

We propose an unsupervised learning method to accurately reconstruct 3D shapes from single-view images without relying on externally supervised signals or a priori shape models. Our innovative approach generates new images and depth maps of different angles by performing pose transformations on top of existing data, with a particular focus on image reconstruction in extreme poses. By using these newly generated images and depth maps as training samples, we re-input the model and optimize it using the generated predictive depth maps. Experimental results show that the proposed method has excellent performance in the task of 3D reconstruction of faces from single-view images, especially in extreme poses, which is significantly better than traditional methods.

Hangzhou Dianzi University (CN)
National Natural Science Foundation of China, Natural Science Foundation of Zhejiang Province
Openalex Percentile: Top 70%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.