Photometric Regularization for 3D Gaussian Splatting in Multi-View Surface Projection
3D surface representation from multi-view photometric stereo (MVPS) remains a challenging task due to accumulated errors and geometric inconsistencies in conventional fusion-based methods. While 3D Gaussian Splatting (3DGS) enables real-time rendering, its explicit point-based representation struggles to preserve fine geometric details when directly applied to MVPS. To address this limitation, we propose PSGS, a novel photometric-regularized Gaussian splatting framework that integrates surface normal priors to enhance multiview surface projection. Specifically, PS-GS introduces three regularization strategies: (1) normal-guided initialization, which aligns Gaussian splats with photometric surface normals; (2) adaptive splat cloning, which dynamically adjusts point density in regions with high normal variation to improve local detail preservation; and (3) visibility-aware occlusion handling, which ensures geometric consistency across multi-view projections. Unlike NeRF-based MVPS methods, our approach does not rely on implicit volumetric representations and instead optimizes explicit surface projections, achieving efficient and artifact-free rendering. Experimental results on the DiLiGenT-MV benchmark demonstrate that PS-GS significantly improves 2D photometric fidelity, achieving a 2.18 dB PSNR gain over NeRFbased MVPS methods while maintaining around 150× faster rendering efficiency. Additionally, our normal-guided splatting enhances view-consistent normal alignment, reducing artifacts in challenging regions. Although PS-GS does not perform full 3D mesh reconstruction or relighting, its efficient rendering and surface-aware regularization make it a promising approach for real-time multi-view image synthesis in MVPS applications.
Authors
- Zheheng Jiang (ORCID: https://orcid.org/0000-0003-1401-7615)
- Jun Xiao (ORCID: https://orcid.org/0000-0002-4935-7866)
- Hui Yu (ORCID: https://orcid.org/0000-0002-5314-8127)
- Junyu Dong (ORCID: https://orcid.org/0000-0001-7012-2087)
- Yuying Zhao (ORCID: https://orcid.org/0009-0001-6976-8638)
- Huiyu Zhou (ORCID: https://orcid.org/0000-0003-1634-9840)
- Yakun Ju (ORCID: https://orcid.org/0000-0003-4065-4108)
- Wei Zhou (ORCID: https://orcid.org/0009-0008-3171-1506)
- Cong Zhang (ORCID: https://orcid.org/0000-0003-2745-1656)
Institutions
- Hong Kong Polytechnic University (HK)
- University of Leicester (GB)
- Nanyang Technological University (SG)
- Institut des Sciences Cognitives Marc Jeannerod (FR)
- Ocean University of China (CN)
- Cardiff University (GB)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Signal Processing
- Published
- 2025-10-03
- DOI
- https://doi.org/10.1109/jstsp.2025.3617861
- Citations
- 2
- Primary Topic
- 3D Surveying and Cultural Heritage
- Type
- article
- Field-Weighted Citation Impact
- 4.69