End-to-end high-fidelity avatar reconstruction using 3D Gaussian splatting with monocular video as the sole input

With the rapid development of Augmented Reality (AR) and Virtual Reality (VR), 3D avatar reconstruction has garnered extensive attention from researchers. However, challenges remain in multi-view-based avatar reconstruction, particularly in accurately aligning features such as hair, clothing, and facial details. Additionally, limitations in avatar representation can lead to unrealistic outcomes under varying lighting conditions. This paper addresses these challenges by introducing a novel tile-based rasterization method that enhances the 3D Gaussian Splatting (3DGS) framework for avatar reconstruction. Our approach utilizes Gaussian ellipsoids initialized through Patch Match Stereo (PMS) and employs both active and passive optimization strategies to refine Gaussian internal parameters and perform effective density filtering. This innovation results in high-fidelity reconstructions without visual artifacts, eliminating the need for facial parameter models and background sampling guidance. Furthermore, our method enables the generation of avatar radiation fields using only monocular video input, simplifying the reconstruction process and reducing execution costs. Experimental results demonstrate that our method outperforms traditional techniques and existing avatar radiation field methods, showcasing its flexibility and lightweight pipeline architecture. This work achieved a competitive results in avatar rendering performance metrics, providing a streamlined solution for high-quality avatar representation.

Publication Details

Journal
Complex & Intelligent Systems
Published
2026-03-24
DOI
https://doi.org/10.1007/s40747-026-02231-5
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

End-to-end high-fidelity avatar reconstruction using 3D Gaussian splatting with monocular video as the sole input

Complex & Intelligent Systems
Face recognition and analysis
article

End-to-end high-fidelity avatar reconstruction using 3D Gaussian splatting with monocular video as the sole input

article en

Abstract

With the rapid development of Augmented Reality (AR) and Virtual Reality (VR), 3D avatar reconstruction has garnered extensive attention from researchers. However, challenges remain in multi-view-based avatar reconstruction, particularly in accurately aligning features such as hair, clothing, and facial details. Additionally, limitations in avatar representation can lead to unrealistic outcomes under varying lighting conditions. This paper addresses these challenges by introducing a novel tile-based rasterization method that enhances the 3D Gaussian Splatting (3DGS) framework for avatar reconstruction. Our approach utilizes Gaussian ellipsoids initialized through Patch Match Stereo (PMS) and employs both active and passive optimization strategies to refine Gaussian internal parameters and perform effective density filtering. This innovation results in high-fidelity reconstructions without visual artifacts, eliminating the need for facial parameter models and background sampling guidance. Furthermore, our method enables the generation of avatar radiation fields using only monocular video input, simplifying the reconstruction process and reducing execution costs. Experimental results demonstrate that our method outperforms traditional techniques and existing avatar radiation field methods, showcasing its flexibility and lightweight pipeline architecture. This work achieved a competitive results in avatar rendering performance metrics, providing a streamlined solution for high-quality avatar representation.

Complex & Intelligent Systems
Industry, innovation and infrastructure
Openalex Percentile: Top 9%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.