ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video

Vision-based 3D sensing provides an effective approach for constructing human-centric digital twins in applications such as ergonomic assessment and human–robot collaboration. However, reconstructing reliable dynamic human digital twins from visual sensor observations remains challenging due to large articulated deformation, which often causes surface discontinuities in existing 3D Gaussian Splatting (3DGS)-based human avatars. Although current methods achieve high image-level rendering quality, their Gaussian primitives are not explicitly adapted to pose-induced surface deformation, resulting in cracks and holes during motion. In this work, we propose ElasticGS, a geometry-consistent human digital twin reconstruction framework for vision-based 3D sensing. ElasticGS introduces a training-free Pose-Aware Dynamic Covariance Adaptation strategy, which dynamically adjusts the rotation and anisotropic scale of Gaussian primitives according to local human surface deformation. Specifically, localized Principal Component Analysis (PCA) is performed on deformed SMPL-X mesh neighborhoods to estimate surface stretching directions and magnitudes, enabling Gaussian representations to maintain continuous surface coverage under complex poses. Furthermore, we propose the Avatar Surface Integrity Score (ASIS), a reference-free metric that evaluates structural completeness and surface compactness of reconstructed human avatars without requiring pixel-aligned ground truth. Experiments on the X-Humans and AvatarReX datasets demonstrate that ElasticGS significantly improves surface integrity while maintaining competitive image-level sensing consistency. Compared with ExAvatar, ElasticGS improves ASIS from 0.642 to 0.846 on X-Humans and from 0.603 to 0.688 on AvatarReX. These results demonstrate the effectiveness of pose-aware covariance adaptation for robust human digital twin reconstruction in vision-based 3D sensing systems.

Authors

Publication Details

Journal
Sensors
Published
2026-11-06
DOI
https://doi.org/10.3390/s26217014
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video

Mengyun Cao, Dong Zhou, Zhe Huang, Chih-Cheng Chen et al.
Sensors
3D Shape Modeling and Analysis
article

ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video

Mengyun Cao, Dong Zhou, Zhe Huang, Chih-Cheng Chen, Haiyang Li
article en

Abstract

Vision-based 3D sensing provides an effective approach for constructing human-centric digital twins in applications such as ergonomic assessment and human–robot collaboration. However, reconstructing reliable dynamic human digital twins from visual sensor observations remains challenging due to large articulated deformation, which often causes surface discontinuities in existing 3D Gaussian Splatting (3DGS)-based human avatars. Although current methods achieve high image-level rendering quality, their Gaussian primitives are not explicitly adapted to pose-induced surface deformation, resulting in cracks and holes during motion. In this work, we propose ElasticGS, a geometry-consistent human digital twin reconstruction framework for vision-based 3D sensing. ElasticGS introduces a training-free Pose-Aware Dynamic Covariance Adaptation strategy, which dynamically adjusts the rotation and anisotropic scale of Gaussian primitives according to local human surface deformation. Specifically, localized Principal Component Analysis (PCA) is performed on deformed SMPL-X mesh neighborhoods to estimate surface stretching directions and magnitudes, enabling Gaussian representations to maintain continuous surface coverage under complex poses. Furthermore, we propose the Avatar Surface Integrity Score (ASIS), a reference-free metric that evaluates structural completeness and surface compactness of reconstructed human avatars without requiring pixel-aligned ground truth. Experiments on the X-Humans and AvatarReX datasets demonstrate that ElasticGS significantly improves surface integrity while maintaining competitive image-level sensing consistency. Compared with ExAvatar, ElasticGS improves ASIS from 0.642 to 0.846 on X-Humans and from 0.603 to 0.688 on AvatarReX. These results demonstrate the effectiveness of pose-aware covariance adaptation for robust human digital twin reconstruction in vision-based 3D sensing systems.

SensorsVol. 26(21)
National Natural Science Foundation of China, Natural Science Foundation of Fujian Province
Openalex Percentile: Top 43%
3D Shape Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon