Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes

3D Gaussian Splatting (3DGS) has emerged as a promising representation for photorealistic rendering of 3D scenes. However, its high storage requirements pose significant challenges for practical applications. We observe that Gaussians exhibit distinct roles and characteristics: some capture high-frequency features like edges and contours, while others represent broader, smoother regions. Based on this observation, we propose a novel hybrid representation that categorizes Gaussians into (i) Sketch Gaussians, which define scene boundaries, and (ii) Patch Gaussians, which cover smooth regions. Sketch Gaussians are efficiently encoded using parametric models, leveraging their geometric coherence, while Patch Gaussians undergo optimized pruning and retraining to maintain volumetric consistency and storage efficiency. Our comprehensive evaluation across diverse indoor and outdoor scenes demonstrates that this structure-aware approach achieves up to 11.52 % improvement in PSNR, 1.83 % in SSIM, and 19.20 % in LPIPS at equivalent model sizes, and correspondingly, for an indoor scene, our model maintains the visual quality with 7.9 % of the original model size.

Authors

Institutions

Publication Details

Published
2025-03-28
DOI
https://doi.org/10.1145/3712677.3720466
Citations
3
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
3.83
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes

Géraldine Morin, Yuang Shi, Wei Tsang Ooi, Simone Gasparini et al.
3 citations
Advanced Vision and Imaging
3.83
article

Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes

Géraldine Morin, Yuang Shi, Wei Tsang Ooi, Simone Gasparini, Chenggang Yang
article en
3 citations

Abstract

3D Gaussian Splatting (3DGS) has emerged as a promising representation for photorealistic rendering of 3D scenes. However, its high storage requirements pose significant challenges for practical applications. We observe that Gaussians exhibit distinct roles and characteristics: some capture high-frequency features like edges and contours, while others represent broader, smoother regions. Based on this observation, we propose a novel hybrid representation that categorizes Gaussians into (i) Sketch Gaussians, which define scene boundaries, and (ii) Patch Gaussians, which cover smooth regions. Sketch Gaussians are efficiently encoded using parametric models, leveraging their geometric coherence, while Patch Gaussians undergo optimized pruning and retraining to maintain volumetric consistency and storage efficiency. Our comprehensive evaluation across diverse indoor and outdoor scenes demonstrates that this structure-aware approach achieves up to 11.52 % improvement in PSNR, 1.83 % in SSIM, and 19.20 % in LPIPS at equivalent model sizes, and correspondingly, for an indoor scene, our model maintains the visual quality with 7.9 % of the original model size.

Université Toulouse III - Paul Sabatier (FR), National University of Singapore (SG), Université Toulouse-I-Capitole (FR), Institut de Recherche en Informatique de Toulouse (FR), Université Toulouse - Jean Jaurès (FR), Institut Polytechnique de Bordeaux (FR)
Openalex Percentile: Top 7%
Advanced Vision and Imaging
3.83
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.