NeRF-based Localization and Meshing with Wearable Laser Scanning System: A Case Study in Underground Environment
Abstract. Due to the subterranean scene’s poor lighting conditions and variability of the environment, real-time localizing and meshing in complex underground scenes present a challenging task, with high-potential applications in mining and tunnel protection. In this work, we propose a method that combines SLAM and NeRF for mesh reconstruction in the underground environment with a wearable device. First, a LiDAR-Inertial odometry is used for pose estimation. The resulting poses and sequential laser frames are synchronized to generate a novel data structure, scan-block, which is crucial for improving efficiency and ensuring local precision. This structure is designed to enhance efficiency and ensure local precision. Finally, the generated scan-blocks are passed to the backend NeRF for real-time mesh reconstruction. The experiments are carried out in a complex underground space. The experimental results proved that this method achieved good results. The demo video can be found at https://youtu.be/_y1vbaW06EM?si= hFnAl12u-ffU933h.
Authors
- Yizhe Zhang (ORCID: https://orcid.org/0009-0008-3938-8838)
- Xin Zhao (ORCID: https://orcid.org/0000-0002-7493-1014)
- Youqi Liao
- Zhen Dong (ORCID: https://orcid.org/0000-0002-0152-3300)
- Jianping Li (ORCID: https://orcid.org/0000-0001-8920-3223)
- Bisheng Yang (ORCID: https://orcid.org/0000-0001-7736-0803)
Institutions
- Nanyang Technological University (SG)
- Wuhan University (CN)
- State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing (CN)
Publication Details
- Journal
- ISPRS annals of the photogrammetry, remote sensing and spatial information sciences
- Published
- 2024-10-18
- DOI
- https://doi.org/10.5194/isprs-annals-x-4-2024-501-2024
- Citations
- 1
- Primary Topic
- 3D Surveying and Cultural Heritage
- Type
- article
- Field-Weighted Citation Impact
- 0.83