NeRF-Based Large-Scale Urban True Digital Orthophoto Map Generation Method

In urban scenes, there are man-made ground objects with complex structures and significant height differences, which leads to challenges in generating large-scale true digital orthophoto maps (TDOMs) of cities. However, traditional TDOM generation methods rely on precise prior geometric information, and this reliance makes it difficult to adapt to such complex environments. In this work, we propose TDOM-NeRF, a novel neural radiance field (NeRF) based method for large-scale urban TDOM generation. Without relying on additional prior information, our method utilizes multiview unmanned aerial vehicle (UAV) images as input and implicitly expresses the scene using hash grid features and multilayer perceptrons. By performing orthogonal volume rendering on the reconstruction results of the scene, we effectively address the problem of uneven scales in the synthetic views when generating TDOM. In actual training, we adopt a scene-block training strategy to extend our method to TDOM generation of large-scale scenes while achieving high-fidelity scene reconstruction. In addition, we regularize the model during training to eliminate erroneous “floating objects” in scene reconstruction, making our method applicable to low-overlap UAV datasets. Experimental results demonstrate that our method generates TDOMs with comparable geometric accuracy and eliminates issues such as ghosting, misalignment, and distortion in challenging areas, compared to commercial photogrammetry software like Metashape and Pix4DMapper. Furthermore, our method exhibits superior novel view synthesis performance compared to advanced NeRF methods like Ortho-NeRF. Our pipeline offers a flexible configuration of scene blocking, enabling a balance between performance and efficiency, which makes it particularly suitable for large-scale scene reconstruction.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2024-11-05
DOI
https://doi.org/10.1109/jstars.2024.3491869
Citations
4
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.82

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NeRF-Based Large-Scale Urban True Digital Orthophoto Map Generation Method

Guobin Zhu, Jiaxin Wei, Xiliang Chen
4 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Remote Sensing and LiDAR Applications
0.82
article

NeRF-Based Large-Scale Urban True Digital Orthophoto Map Generation Method

Guobin Zhu, Jiaxin Wei, Xiliang Chen
article en
4 citations

Abstract

In urban scenes, there are man-made ground objects with complex structures and significant height differences, which leads to challenges in generating large-scale true digital orthophoto maps (TDOMs) of cities. However, traditional TDOM generation methods rely on precise prior geometric information, and this reliance makes it difficult to adapt to such complex environments. In this work, we propose TDOM-NeRF, a novel neural radiance field (NeRF) based method for large-scale urban TDOM generation. Without relying on additional prior information, our method utilizes multiview unmanned aerial vehicle (UAV) images as input and implicitly expresses the scene using hash grid features and multilayer perceptrons. By performing orthogonal volume rendering on the reconstruction results of the scene, we effectively address the problem of uneven scales in the synthetic views when generating TDOM. In actual training, we adopt a scene-block training strategy to extend our method to TDOM generation of large-scale scenes while achieving high-fidelity scene reconstruction. In addition, we regularize the model during training to eliminate erroneous “floating objects” in scene reconstruction, making our method applicable to low-overlap UAV datasets. Experimental results demonstrate that our method generates TDOMs with comparable geometric accuracy and eliminates issues such as ghosting, misalignment, and distortion in challenging areas, compared to commercial photogrammetry software like Metashape and Pix4DMapper. Furthermore, our method exhibits superior novel view synthesis performance compared to advanced NeRF methods like Ortho-NeRF. Our pipeline offers a flexible configuration of scene blocking, enabling a balance between performance and efficiency, which makes it particularly suitable for large-scale scene reconstruction.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Wuhan University (CN)
National Natural Science Foundation of China
Sustainable cities and communities
Openalex Percentile: Top 30%
Remote Sensing and LiDAR Applications
0.82
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.