Depth-Regularized 3D Gaussian Splatting for Indoor Panoramic images

3D Gaussian Splatting (3DGS) has recently made notable progress in photo-realistic view synthesis and 3D reconstruction from multi-view images. It initializes anisotropic Gaussian representations of complex scenes using sparse point clouds and optimizes these Gaussians using multiple perspective images. To apply 3DGS to panoramic images, we propose a panoramic view synthesis method. Specifically, each panoramic image is divided into multiple perspective images to obtain sparse point clouds and camera parameters through SfM. However, this division introduces stitching artifacts. To tackle this issue, we utilize a pre-trained depth estimation model to estimate depth as geometric guidance for depth supervision, where the inverse depth of each frame's SfM points is used to resolve scale and offset issues. We verify the proposed method on a custom indoor panoramic dataset. Compared to the original 3DGS, our method achieves relatively robust geometric structures and effectively reduces some artifacts. In addition, our method has the same effect after 7K iterations as 3DGS does after 30K iterations, and uses fewer Gaussians to represent the scene.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1145/3703187.3703240
Citations
2
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Depth-Regularized 3D Gaussian Splatting for Indoor Panoramic images

Wei Feng, Weijun Wang, Jie Luo, Tianlun Huang
2 citations
Advanced Vision and Imaging
0.50
article

Depth-Regularized 3D Gaussian Splatting for Indoor Panoramic images

Wei Feng, Weijun Wang, Jie Luo, Tianlun Huang
article en
2 citations

Abstract

3D Gaussian Splatting (3DGS) has recently made notable progress in photo-realistic view synthesis and 3D reconstruction from multi-view images. It initializes anisotropic Gaussian representations of complex scenes using sparse point clouds and optimizes these Gaussians using multiple perspective images. To apply 3DGS to panoramic images, we propose a panoramic view synthesis method. Specifically, each panoramic image is divided into multiple perspective images to obtain sparse point clouds and camera parameters through SfM. However, this division introduces stitching artifacts. To tackle this issue, we utilize a pre-trained depth estimation model to estimate depth as geometric guidance for depth supervision, where the inverse depth of each frame's SfM points is used to resolve scale and offset issues. We verify the proposed method on a custom indoor panoramic dataset. Compared to the original 3DGS, our method achieves relatively robust geometric structures and effectively reduces some artifacts. In addition, our method has the same effect after 7K iterations as 3DGS does after 30K iterations, and uses fewer Gaussians to represent the scene.

Chinese Academy of Sciences (CN), Shenzhen Institutes of Advanced Technology (CN), University of Chinese Academy of Sciences (CN)
Openalex Percentile: Top 32%
Advanced Vision and Imaging
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.