Multi-Reference Geometric Risk and Sparse Depth Refinement for Streaming 3D Reconstruction
Streaming feed-forward 3D reconstruction produces depth predictions at successive frames, but cross-view geometric consistency and local depth accuracy may vary. We present a training-free, output-level approach that combines Multi-Reference Geometric Risk assessment with global-referenced conservative sparse depth refinement, leaving the pretrained backbone, its predicted poses, and its streaming state unchanged. Risk derived from predicted depth, intrinsics, and poses achieves a median Spearman correlation of 0.635 with scale-aligned depth error across 11 public scenes and a correlation of 0.556 on the real-robot Sequence E. With matched 2% sparse depth anchors, local refinement reduces Sequence E held-out AbsRel by 40.69% relative to Sparse Global. Spatial refinement also improves mean held-out depth error in all 55 public scene–policy comparisons and all 200 predefined fixed-mask scene–policy–seed comparisons. Retrospective risk-based frame ranking provides diagnostic benefits under reference-scale normalization, but the observed allocation gains are protocol-dependent and do not establish consistent improvements under historical sparse-scale propagation or deployable online scheduling. In an independent Bonn Leica comparison using shared ground-truth camera poses, Spatial increases recall at a 5 cm threshold but has lower precision and F-score than Sparse Global. These findings establish the value of conservative sparse depth refinement and multi-reference risk as complementary geometric-quality evidence, while distinguishing depth accuracy from downstream 3D geometric performance.
Authors
- Yuming Qi
- Wei Sun
- Meijing Ge
- Chunguang Wang
- Jianlong Zheng
Institutions
- Tianjin University of Technology and Education (CN)
- TianjinSino-German University of Applied Sciences (CN)
Publication Details
- Journal
- Sensors
- Published
- 2026-11-05
- DOI
- https://doi.org/10.3390/s26216995
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.00