Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes
3D Gaussian Splatting (3DGS) has emerged as a promising representation for photorealistic rendering of 3D scenes. However, its high storage requirements pose significant challenges for practical applications. We observe that Gaussians exhibit distinct roles and characteristics: some capture high-frequency features like edges and contours, while others represent broader, smoother regions. Based on this observation, we propose a novel hybrid representation that categorizes Gaussians into (i) Sketch Gaussians, which define scene boundaries, and (ii) Patch Gaussians, which cover smooth regions. Sketch Gaussians are efficiently encoded using parametric models, leveraging their geometric coherence, while Patch Gaussians undergo optimized pruning and retraining to maintain volumetric consistency and storage efficiency. Our comprehensive evaluation across diverse indoor and outdoor scenes demonstrates that this structure-aware approach achieves up to 11.52 % improvement in PSNR, 1.83 % in SSIM, and 19.20 % in LPIPS at equivalent model sizes, and correspondingly, for an indoor scene, our model maintains the visual quality with 7.9 % of the original model size.
Authors
- Géraldine Morin (ORCID: https://orcid.org/0000-0003-0925-3277)
- Yuang Shi (ORCID: https://orcid.org/0000-0002-7893-8512)
- Wei Tsang Ooi (ORCID: https://orcid.org/0000-0001-8994-1736)
- Simone Gasparini (ORCID: https://orcid.org/0000-0001-8239-8005)
- Chenggang Yang
Institutions
- Université Toulouse III - Paul Sabatier (FR)
- National University of Singapore (SG)
- Université Toulouse-I-Capitole (FR)
- Institut de Recherche en Informatique de Toulouse (FR)
- Université Toulouse - Jean Jaurès (FR)
- Institut Polytechnique de Bordeaux (FR)
Publication Details
- Published
- 2025-03-28
- DOI
- https://doi.org/10.1145/3712677.3720466
- Citations
- 3
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 3.83