Photometric Regularization for 3D Gaussian Splatting in Multi-View Surface Projection

3D surface representation from multi-view photometric stereo (MVPS) remains a challenging task due to accumulated errors and geometric inconsistencies in conventional fusion-based methods. While 3D Gaussian Splatting (3DGS) enables real-time rendering, its explicit point-based representation struggles to preserve fine geometric details when directly applied to MVPS. To address this limitation, we propose PSGS, a novel photometric-regularized Gaussian splatting framework that integrates surface normal priors to enhance multiview surface projection. Specifically, PS-GS introduces three regularization strategies: (1) normal-guided initialization, which aligns Gaussian splats with photometric surface normals; (2) adaptive splat cloning, which dynamically adjusts point density in regions with high normal variation to improve local detail preservation; and (3) visibility-aware occlusion handling, which ensures geometric consistency across multi-view projections. Unlike NeRF-based MVPS methods, our approach does not rely on implicit volumetric representations and instead optimizes explicit surface projections, achieving efficient and artifact-free rendering. Experimental results on the DiLiGenT-MV benchmark demonstrate that PS-GS significantly improves 2D photometric fidelity, achieving a 2.18 dB PSNR gain over NeRFbased MVPS methods while maintaining around 150× faster rendering efficiency. Additionally, our normal-guided splatting enhances view-consistent normal alignment, reducing artifacts in challenging regions. Although PS-GS does not perform full 3D mesh reconstruction or relighting, its efficient rendering and surface-aware regularization make it a promising approach for real-time multi-view image synthesis in MVPS applications.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Signal Processing
Published
2025-10-03
DOI
https://doi.org/10.1109/jstsp.2025.3617861
Citations
2
Primary Topic
3D Surveying and Cultural Heritage
Type
article
Field-Weighted Citation Impact
4.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Photometric Regularization for 3D Gaussian Splatting in Multi-View Surface Projection

Zheheng Jiang, Jun Xiao, Hui Yu, Junyu Dong et al.
2 citations
IEEE Journal of Selected Topics in Signal Processing
3D Surveying and Cultural Heritage
4.69
article

Photometric Regularization for 3D Gaussian Splatting in Multi-View Surface Projection

Zheheng Jiang, Jun Xiao, Hui Yu, Junyu Dong, Yuying Zhao, Huiyu Zhou, Yakun Ju, Wei Zhou, Cong Zhang
article en
2 citations

Abstract

3D surface representation from multi-view photometric stereo (MVPS) remains a challenging task due to accumulated errors and geometric inconsistencies in conventional fusion-based methods. While 3D Gaussian Splatting (3DGS) enables real-time rendering, its explicit point-based representation struggles to preserve fine geometric details when directly applied to MVPS. To address this limitation, we propose PSGS, a novel photometric-regularized Gaussian splatting framework that integrates surface normal priors to enhance multiview surface projection. Specifically, PS-GS introduces three regularization strategies: (1) normal-guided initialization, which aligns Gaussian splats with photometric surface normals; (2) adaptive splat cloning, which dynamically adjusts point density in regions with high normal variation to improve local detail preservation; and (3) visibility-aware occlusion handling, which ensures geometric consistency across multi-view projections. Unlike NeRF-based MVPS methods, our approach does not rely on implicit volumetric representations and instead optimizes explicit surface projections, achieving efficient and artifact-free rendering. Experimental results on the DiLiGenT-MV benchmark demonstrate that PS-GS significantly improves 2D photometric fidelity, achieving a 2.18 dB PSNR gain over NeRFbased MVPS methods while maintaining around 150× faster rendering efficiency. Additionally, our normal-guided splatting enhances view-consistent normal alignment, reducing artifacts in challenging regions. Although PS-GS does not perform full 3D mesh reconstruction or relighting, its efficient rendering and surface-aware regularization make it a promising approach for real-time multi-view image synthesis in MVPS applications.

IEEE Journal of Selected Topics in Signal ProcessingVol. 19(8)
Hong Kong Polytechnic University (HK), University of Leicester (GB), Nanyang Technological University (SG), Institut des Sciences Cognitives Marc Jeannerod (FR), Ocean University of China (CN), Cardiff University (GB)
Openalex Percentile: Top 5%
3D Surveying and Cultural Heritage
4.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.