Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging

Non-Line-of-Sight Imaging (NLOS Imaging) is an advanced technique designed to capture images of scenes that are not directly visible to the camera. This method leverages transient sensors to collect time-resolved signals, enabling the reconstruction of hidden scenes. Traditional NLOS imaging techniques rely solely on surface normals rather than depth information to represent implicit surfaces. This limitation results in less accurate refinement of the surface features of reconstructed objects. To address this issue, our research introduces a novel neural implicit learning approach that incorporates depth information for optimization. By integrating depth data, we achieve more precise surface reconstruction in NLOS environments. The process involves extracting depth information through the fusion of albedo plots obtained from different perspectives, which are generated by transient images and optical flow. This combined data enhances the accuracy and quality of the reconstructed images. Additionally, we introduce a depth loss component to facilitate smoother reconstruction of object surfaces while simultaneously constraining the Signed Distance Function (SDF) regression. This dual approach ensures that the reconstructed surfaces are both smooth and accurately defined. Our method has been rigorously tested on both synthetic and real datasets, and the experimental results demonstrate its superiority over existing techniques. Our approach consistently delivers high-quality reconstructions of hidden objects in various scenarios, outperforming current methods in terms of precision and detail.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1117/12.3047204
Primary Topic
Advanced Optical Sensing Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging

Hao Liu, Kang Meng, Fengchang Miao
Advanced Optical Sensing Technologies
article

Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging

Hao Liu, Kang Meng, Fengchang Miao
article en

Abstract

Non-Line-of-Sight Imaging (NLOS Imaging) is an advanced technique designed to capture images of scenes that are not directly visible to the camera. This method leverages transient sensors to collect time-resolved signals, enabling the reconstruction of hidden scenes. Traditional NLOS imaging techniques rely solely on surface normals rather than depth information to represent implicit surfaces. This limitation results in less accurate refinement of the surface features of reconstructed objects. To address this issue, our research introduces a novel neural implicit learning approach that incorporates depth information for optimization. By integrating depth data, we achieve more precise surface reconstruction in NLOS environments. The process involves extracting depth information through the fusion of albedo plots obtained from different perspectives, which are generated by transient images and optical flow. This combined data enhances the accuracy and quality of the reconstructed images. Additionally, we introduce a depth loss component to facilitate smoother reconstruction of object surfaces while simultaneously constraining the Signed Distance Function (SDF) regression. This dual approach ensures that the reconstructed surfaces are both smooth and accurately defined. Our method has been rigorously tested on both synthetic and real datasets, and the experimental results demonstrate its superiority over existing techniques. Our approach consistently delivers high-quality reconstructions of hidden objects in various scenarios, outperforming current methods in terms of precision and detail.

National University of Defense Technology (CN), Zhengzhou University (CN)
Openalex Percentile: Top 82%
Advanced Optical Sensing Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Depth-NLOS: surface detail reconstruction from depth information in non-line-of-sight imaging — Hao Liu, Kang Meng, et al. · (2024) | TGRS Research Map | TGRS