Local Gaussian Density Mixtures for Unstructured Lumigraph Rendering
from a small set of neighboring images.For fusion, we use a neural blending weight from a shallow MLP.We optimize the local Gaussian density mixtures using both a reconstruction loss and a consistency loss.The consistency loss, based on per-ray KL-divergence, encourages more accurate geometry reconstruction.In scenes with complex reflections captured in our LGDM dataset, the experimental results show that our method outperforms stateof-the-art novel view synthesis methods by 12.2%-37.1% in PSNR, due to its ability to maintain sharper view-dependent appearances.Project webpage: https://xchaowu.github.io/papers/lgdm/index.html
Authors
- Qixing Huang (ORCID: https://orcid.org/0000-0001-6365-8051)
- James Tompkin (ORCID: https://orcid.org/0000-0003-2218-2899)
- Chi Wang (ORCID: https://orcid.org/0000-0003-1686-2687)
- Jiamin Xu (ORCID: https://orcid.org/0000-0002-7750-7761)
- Yifan Peng (ORCID: https://orcid.org/0000-0003-0667-2599)
- Weiwei Xu (ORCID: https://orcid.org/0000-0003-3756-3539)
- X Wu (ORCID: https://orcid.org/0000-0002-4952-8581)
Institutions
- Brown University (US)
- Hangzhou Dianzi University (CN)
- Zhejiang University (CN)
- The University of Texas at Austin (US)
- University of Hong Kong (HK)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1145/3680528.3687659
- Citations
- 1
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.25
Funders
- National Science Foundation
- Ant Group
- National Natural Science Foundation of China
- Zhejiang University
- Natural Science Foundation of Zhejiang Province