Animatable NeRF Dynamic Detail Enhancement Based on Residual Deformation Field with Progressive Training

We present a novel animatable neural radiance field (Animatable NeRF) framework incorporating a residual deformation field (RDF) to address the limitations of current monocular video-driven human reconstruction techniques. While existing Animatable NeRF approaches demonstrate promising results, they exhibit significant constraints in capturing fine-grained dynamic details, particularly in clothing wrinkles and hair motion. To overcome these limitations, we propose a comprehensive solution featuring two key innovations: 1) Residual Deformation Field (RDF): Predicts local displacement residuals in canonical space, effectively decoupling global pose from dynamic details; 2) Progressive Training: A staged optimization strategy that prevents local details from interfering with the learning of global deformations. Experimental evaluations demonstrate that our framework advances human geometry and appearance reconstruction capabilities, enables high-fidelity novel-view synthesis, and supports robust human animation under novel poses.

Authors

Institutions

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1109/iccgiv65419.2025.11085326
Primary Topic
Advanced Optical Sensing Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Animatable NeRF Dynamic Detail Enhancement Based on Residual Deformation Field with Progressive Training

Shenhao Zhang, Yuhang Han, Xiaohui Zhang, Menglei Yang
4 links
Advanced Optical Sensing Technologies
article

Animatable NeRF Dynamic Detail Enhancement Based on Residual Deformation Field with Progressive Training

Shenhao Zhang, Yuhang Han, Xiaohui Zhang, Menglei Yang
article en

Abstract

We present a novel animatable neural radiance field (Animatable NeRF) framework incorporating a residual deformation field (RDF) to address the limitations of current monocular video-driven human reconstruction techniques. While existing Animatable NeRF approaches demonstrate promising results, they exhibit significant constraints in capturing fine-grained dynamic details, particularly in clothing wrinkles and hair motion. To overcome these limitations, we propose a comprehensive solution featuring two key innovations: 1) Residual Deformation Field (RDF): Predicts local displacement residuals in canonical space, effectively decoupling global pose from dynamic details; 2) Progressive Training: A staged optimization strategy that prevents local details from interfering with the learning of global deformations. Experimental evaluations demonstrate that our framework advances human geometry and appearance reconstruction capabilities, enables high-fidelity novel-view synthesis, and supports robust human animation under novel poses.

Zhengzhou University (CN), Jinan Institute of Quantum Technology (CN), Coal Industry Jinan Design & Research Institute (China) (CN)
Climate action
Openalex Percentile: Top 80%
Advanced Optical Sensing Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.