Text-to-3D scene generation framework: bridging textual descriptions to high-fidelity 3D scenes
Text-to-3D scene generation is pivotal for digital content creation; however, existing methods often struggle with global consistency across views. We present 3DS-Gen, a modular "generate-then-reconstruct" framework that first produces a temporally coherent multi-view video prior and then reconstructs consistent 3D scenes using sparse geometry estimation and Gaussian optimization. A cascaded variational autoencoder (2D for spatial compression and 3D for temporal compression) provides a compact and coherent latent sequence that facilitates robust reconstruction. An adaptive density threshold improves detailed allocation in the Gaussian stage under a fixed computational budget. While explicit meshes can be extracted from the optimized representation when needed, our claims emphasize multiview consistency and reconstructability; the mesh quality depends on the video prior and the chosen explicitification backend. 3DS-Gen runs on a single GPU and yields coherent scene reconstructions across diverse prompts, thereby providing a practical bridge between text and 3D content creation.
Authors
- Zuan Gu (ORCID: https://orcid.org/0009-0005-9846-6945)
- Huimin Liu (ORCID: https://orcid.org/0000-0001-6224-5124)
- Tianhan Gao (ORCID: https://orcid.org/0000-0002-9250-3777)
Institutions
- Northeastern University (CN)
Publication Details
- Journal
- Visual Computing for Industry Biomedicine and Art
- Published
- 2025-12-18
- DOI
- https://doi.org/10.1186/s42492-025-00210-0
- Primary Topic
- Generative Adversarial Networks and Image Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China