Text‐Driven High‐Quality 3D Human Generation via Variational Gradient Estimation and Latent Reward Models

ABSTRACT Recent advances in Score Distillation Sampling (SDS) have enabled text‐driven 3D human generation, yet the standard classifier‐free guidance (CFG) framework struggles with semantic misalignment and texture oversaturation due to limited model capacity. We propose a novel framework that decouples conditional and unconditional guidance via a dual‐model strategy: A pretrained diffusion model ensures geometric stability, while a preference‐tuned latent reward model enhances semantic fidelity. To further refine noise estimation, we introduce a lightweight U‐shaped Swin Transformer (U‐Swin) that regularizes predicted noise against the reward model, reducing gradient bias and local artifacts. Additionally, we design a time‐varying noise weighting mechanism to dynamically balance the two guidance signals during denoising, improving stability and texture realism. Extensive experiments show that our method significantly improves alignment with textual descriptions, enhances texture details, and outperforms state‐of‐the‐art baselines in both visual quality and semantic consistency.

Authors

Institutions

Publication Details

Journal
Computer Animation and Virtual Worlds
Published
2026-01-01
DOI
https://doi.org/10.1002/cav.70089
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Text‐Driven High‐Quality 3D Human Generation via Variational Gradient Estimation and Latent Reward Models

Pengfei Zhou, Yi Hu, Xukun Shen
Computer Animation and Virtual Worlds
Generative Adversarial Networks and Image Synthesis
article

Text‐Driven High‐Quality 3D Human Generation via Variational Gradient Estimation and Latent Reward Models

Pengfei Zhou, Yi Hu, Xukun Shen
article en

Abstract

ABSTRACT Recent advances in Score Distillation Sampling (SDS) have enabled text‐driven 3D human generation, yet the standard classifier‐free guidance (CFG) framework struggles with semantic misalignment and texture oversaturation due to limited model capacity. We propose a novel framework that decouples conditional and unconditional guidance via a dual‐model strategy: A pretrained diffusion model ensures geometric stability, while a preference‐tuned latent reward model enhances semantic fidelity. To further refine noise estimation, we introduce a lightweight U‐shaped Swin Transformer (U‐Swin) that regularizes predicted noise against the reward model, reducing gradient bias and local artifacts. Additionally, we design a time‐varying noise weighting mechanism to dynamically balance the two guidance signals during denoising, improving stability and texture realism. Extensive experiments show that our method significantly improves alignment with textual descriptions, enhances texture details, and outperforms state‐of‐the‐art baselines in both visual quality and semantic consistency.

Computer Animation and Virtual WorldsVol. 37(1)
Beihang University (CN)
Openalex Percentile: Top 94%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.