GaussianEnhancer++: A General GS-Agnostic Rendering Enhancer
Gaussian Splatting (GS) methods, including 3DGS and 2DGS, have demonstrated significant effectiveness in real-time novel view synthesis (NVS), establishing themselves as a key technology in the field of computer graphics. However, GS-based methods still face challenges in rendering high-quality image details. Even when utilizing advanced frameworks, their outputs may display significant rendering artifacts when relying solely on a few input views, such as noise and blurriness. A reasonable approach is to conduct post-processing in order to restore clear details. Therefore, we propose GaussianEnhancer, a general GS-agnostic post-processor that employs a degradation-driven view blending method to improve the rendering quality of GS models. Specifically, we design a degradation modeling method tailored to the GS style and construct a large-scale training dataset to effectively simulate the native rendering artifacts of GS, enabling efficient training. In addition, we present a spatial information fusion framework that includes view fusion and depth modulation modules. This framework successfully integrates related images and leverages depth information from the target image to enhance rendering details. Through our GaussianEnhancer, we effectively eliminate the rendering artifacts of GS models and generate highly realistic image details. Based on GaussianEnhancer, we introduce GaussianEnhancer++, which features an enhanced GS-style degradation simulator, leading to improved enhancement quality. Furthermore, GaussianEnhancer++ can generate ultra-high-resolution outputs from noisy low resolution GS rendered images by leveraging the symmetry between high-resolution and low resolution images. Extensive experiments demonstrate the excellent restoration ability of GaussianEnhancer++ on various novel view synthesis benchmarks.
Authors
- Shanghang Zhang (ORCID: https://orcid.org/0000-0003-4047-3526)
- Jia Wang (ORCID: https://orcid.org/0000-0002-1570-4962)
- Zhaowei Qu (ORCID: https://orcid.org/0000-0002-8819-6778)
- Chen Zou (ORCID: https://orcid.org/0000-0003-4017-9677)
- Zhaofeng He (ORCID: https://orcid.org/0000-0002-3433-8435)
- Qingsen Ma (ORCID: https://orcid.org/0000-0001-8059-0458)
- Ming Lu (ORCID: https://orcid.org/0000-0002-1701-9133)
Institutions
- Beijing University of Posts and Telecommunications (CN)
- Peking University (CN)
Publication Details
- Journal
- Symmetry
- Published
- 2025-03-15
- DOI
- https://doi.org/10.3390/sym17030442
- Citations
- 1
- Primary Topic
- Computer Graphics and Visualization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 3.54