Multi-Reference Geometric Risk and Sparse Depth Refinement for Streaming 3D Reconstruction

Streaming feed-forward 3D reconstruction produces depth predictions at successive frames, but cross-view geometric consistency and local depth accuracy may vary. We present a training-free, output-level approach that combines Multi-Reference Geometric Risk assessment with global-referenced conservative sparse depth refinement, leaving the pretrained backbone, its predicted poses, and its streaming state unchanged. Risk derived from predicted depth, intrinsics, and poses achieves a median Spearman correlation of 0.635 with scale-aligned depth error across 11 public scenes and a correlation of 0.556 on the real-robot Sequence E. With matched 2% sparse depth anchors, local refinement reduces Sequence E held-out AbsRel by 40.69% relative to Sparse Global. Spatial refinement also improves mean held-out depth error in all 55 public scene–policy comparisons and all 200 predefined fixed-mask scene–policy–seed comparisons. Retrospective risk-based frame ranking provides diagnostic benefits under reference-scale normalization, but the observed allocation gains are protocol-dependent and do not establish consistent improvements under historical sparse-scale propagation or deployable online scheduling. In an independent Bonn Leica comparison using shared ground-truth camera poses, Spatial increases recall at a 5 cm threshold but has lower precision and F-score than Sparse Global. These findings establish the value of conservative sparse depth refinement and multi-reference risk as complementary geometric-quality evidence, while distinguishing depth accuracy from downstream 3D geometric performance.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-11-05
DOI
https://doi.org/10.3390/s26216995
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multi-Reference Geometric Risk and Sparse Depth Refinement for Streaming 3D Reconstruction

Yuming Qi, Wei Sun, Meijing Ge, Chunguang Wang et al.
Sensors
Advanced Vision and Imaging
article

Multi-Reference Geometric Risk and Sparse Depth Refinement for Streaming 3D Reconstruction

Yuming Qi, Wei Sun, Meijing Ge, Chunguang Wang, Jianlong Zheng
article en

Abstract

Streaming feed-forward 3D reconstruction produces depth predictions at successive frames, but cross-view geometric consistency and local depth accuracy may vary. We present a training-free, output-level approach that combines Multi-Reference Geometric Risk assessment with global-referenced conservative sparse depth refinement, leaving the pretrained backbone, its predicted poses, and its streaming state unchanged. Risk derived from predicted depth, intrinsics, and poses achieves a median Spearman correlation of 0.635 with scale-aligned depth error across 11 public scenes and a correlation of 0.556 on the real-robot Sequence E. With matched 2% sparse depth anchors, local refinement reduces Sequence E held-out AbsRel by 40.69% relative to Sparse Global. Spatial refinement also improves mean held-out depth error in all 55 public scene–policy comparisons and all 200 predefined fixed-mask scene–policy–seed comparisons. Retrospective risk-based frame ranking provides diagnostic benefits under reference-scale normalization, but the observed allocation gains are protocol-dependent and do not establish consistent improvements under historical sparse-scale propagation or deployable online scheduling. In an independent Bonn Leica comparison using shared ground-truth camera poses, Spatial increases recall at a 5 cm threshold but has lower precision and F-score than Sparse Global. These findings establish the value of conservative sparse depth refinement and multi-reference risk as complementary geometric-quality evidence, while distinguishing depth accuracy from downstream 3D geometric performance.

SensorsVol. 26(21)
Tianjin University of Technology and Education (CN), TianjinSino-German University of Applied Sciences (CN)
Openalex Percentile: Top 20%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon