3D reconstruction of traffic scene images using neural radiance fields (NeRF) and target association

Challenges such as multi-target motion, complex occlusion and drastic perspective changes in traffic scenes often cause target aliasing and semantic inconsistency in 3D reconstruction using Neural Radiance Fields (NeRF) in dynamic environments. This study proposes a spatiotemporal consistency NeRF method based on dynamic instance decomposition. A foreground-segmentation network first semantically decouples each frame into static background and dynamic instances. Cross-frame instance correspondence is established using optical flow constraints, while a temporal consistency module estimates target motion parameters for continuous dynamic mapping. Independent instance index encoding is embedded in body density and radiation functions to enable NeRF to distinguish objects’ implicit radiation distributions during training. The method jointly optimises volume rendering errors for static and dynamic regions, introducing a spatiotemporal smoothing regularisation term to maintain geometric continuity and temporal consistency. Experimental results demonstrate that static background reconstruction achieves an SSIM of 0.982, 0.034 higher than standard NeRF. Dynamic object reconstruction improves vehicle Object Association Accuracy (OAA) to 0.958 and Temporal Consistency Index (TCI) to 0.953. Overall reconstruction error averaged over all valid rendering pixels is reduced to 0.012, with improved geometric continuity. These results confirm that the proposed approach enables high-precision 3D reconstruction and target association in multi-object dynamic traffic scenes.

Authors

Institutions

Publication Details

Journal
International Journal of Image and Data Fusion
Published
2026-08-17
DOI
https://doi.org/10.1080/19479832.2026.2718747
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

3D reconstruction of traffic scene images using neural radiance fields (NeRF) and target association

Dandan Deng
International Journal of Image and Data Fusion
Advanced Vision and Imaging
article

3D reconstruction of traffic scene images using neural radiance fields (NeRF) and target association

Dandan Deng
article en

Abstract

Challenges such as multi-target motion, complex occlusion and drastic perspective changes in traffic scenes often cause target aliasing and semantic inconsistency in 3D reconstruction using Neural Radiance Fields (NeRF) in dynamic environments. This study proposes a spatiotemporal consistency NeRF method based on dynamic instance decomposition. A foreground-segmentation network first semantically decouples each frame into static background and dynamic instances. Cross-frame instance correspondence is established using optical flow constraints, while a temporal consistency module estimates target motion parameters for continuous dynamic mapping. Independent instance index encoding is embedded in body density and radiation functions to enable NeRF to distinguish objects’ implicit radiation distributions during training. The method jointly optimises volume rendering errors for static and dynamic regions, introducing a spatiotemporal smoothing regularisation term to maintain geometric continuity and temporal consistency. Experimental results demonstrate that static background reconstruction achieves an SSIM of 0.982, 0.034 higher than standard NeRF. Dynamic object reconstruction improves vehicle Object Association Accuracy (OAA) to 0.958 and Temporal Consistency Index (TCI) to 0.953. Overall reconstruction error averaged over all valid rendering pixels is reduced to 0.012, with improved geometric continuity. These results confirm that the proposed approach enables high-precision 3D reconstruction and target association in multi-object dynamic traffic scenes.

International Journal of Image and Data FusionVol. 17(1)
Xinjiang Institute of Engineering (CN)
Sustainable cities and communities
Openalex Percentile: Top 11%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.