Differentiable Space Carving for 3D Reconstruction Using Imaging Sonar

Effective 3D reconstruction utilizing imaging sonars is vital for underwater robots, particularly in turbid water conditions. The absence of elevation angles in acoustic echo measurements significantly slows down the Neural Radiance Field (NeRF) method. This is attributed to the differentiable rendering model of sonar images, which, unlike visual imagery, needs to generate samples covering a spatial sector rather than a ray for each pixel. To address this, we present a fast 3D reconstruction method using sonar images, termed Differentiable Space Carving (DSC). DSC carves the space iteratively by rendering echo probabilities instead of echo intensities, eliminating the need for the intensity network commonly found in NeRF models. The absence of occupancy-echo correspondences is effectively tackled through backpropagation guided by rendering losses. Additionally, we leverage occupancy probability grids and multiresolution hash encoding to construct differentiable occupancy models, ensuring faster convergence compared to multilayer perceptrons. The experiments have been conducted in numerically simulated environments and with datasets from a laboratory tank. Compared to existing NeRF methods, DSC reconstructs objects about ten times faster and provides more details.

Authors

Institutions

Publication Details

Journal
IEEE Robotics and Automation Letters
Published
2024-09-27
DOI
https://doi.org/10.1109/lra.2024.3469778
Citations
11
Primary Topic
3D Surveying and Cultural Heritage
Type
article
Field-Weighted Citation Impact
9.18

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Differentiable Space Carving for 3D Reconstruction Using Imaging Sonar

Kaiyang Lin, Wenjie Lu, Liang Hu, Yunxuan Feng et al.
11 citations
IEEE Robotics and Automation Letters
3D Surveying and Cultural Heritage
9.18
article

Differentiable Space Carving for 3D Reconstruction Using Imaging Sonar

Kaiyang Lin, Wenjie Lu, Liang Hu, Yunxuan Feng, Haowen Gao, Binyu Nie
article en
11 citations

Abstract

Effective 3D reconstruction utilizing imaging sonars is vital for underwater robots, particularly in turbid water conditions. The absence of elevation angles in acoustic echo measurements significantly slows down the Neural Radiance Field (NeRF) method. This is attributed to the differentiable rendering model of sonar images, which, unlike visual imagery, needs to generate samples covering a spatial sector rather than a ray for each pixel. To address this, we present a fast 3D reconstruction method using sonar images, termed Differentiable Space Carving (DSC). DSC carves the space iteratively by rendering echo probabilities instead of echo intensities, eliminating the need for the intensity network commonly found in NeRF models. The absence of occupancy-echo correspondences is effectively tackled through backpropagation guided by rendering losses. Additionally, we leverage occupancy probability grids and multiresolution hash encoding to construct differentiable occupancy models, ensuring faster convergence compared to multilayer perceptrons. The experiments have been conducted in numerically simulated environments and with datasets from a laboratory tank. Compared to existing NeRF methods, DSC reconstructs objects about ten times faster and provides more details.

IEEE Robotics and Automation LettersVol. 9(11)
Harbin Institute of Technology (CN), Shenzhen Academy of Robotics (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 2%
3D Surveying and Cultural Heritage
9.18
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.