VISTA+: Mesh-based single-view novel view synthesis and CAD-based foreground composition for synthetic driving-scene generation

Synthetic data has emerged as a promising solution for alleviating data scarcity in autonomous driving, especially in cold-start and corner-case scenarios. However, existing synthetic data generation methods still face a trade-off between photorealistic fidelity and engineering scalability. This paper proposes VISTA+, a framework for synthetic driving-scene generation that combines mesh-based single-view novel view synthesis (NVS) of static backgrounds with computer-aided design (CAD)-based foreground rendering and foreground-background composition. Unlike multi-view neural reconstruction methods, VISTA+ avoids large-scale multi-view scene reconstruction, while still requiring camera calibration and source-to-target relative poses, thereby reducing engineering complexity. Specifically, we improve mesh-based background NVS by incorporating foreground inpainting, dense depth supervision, structural pretraining, and joint depth-offset prediction. Dynamic foreground objects are rendered using CAD assets under estimated environmental lighting and are then integrated with generated backgrounds through image harmonization. Experiments on KITTI and nuScenes demonstrate that VISTA+ outperforms representative single-view NVS baselines in terms of peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). Furthermore, synthetic data generated by VISTA+ consistently improves the performance of multiple downstream three-dimensional (3D) object detection models, demonstrating the downstream utility and functional realism of the generated driving scenes.

Authors

Publication Details

Journal
Journal of Intelligent and Connected Vehicles
Published
2026-11-19
DOI
https://doi.org/10.26599/jicv.2026.9210110
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

VISTA+: Mesh-based single-view novel view synthesis and CAD-based foreground composition for synthetic driving-scene generation

Song Zhang, Wenxiu Shi, Ruibo Wang, Haiquan Liu et al.
Journal of Intelligent and Connected Vehicles
Advanced Vision and Imaging
article

VISTA+: Mesh-based single-view novel view synthesis and CAD-based foreground composition for synthetic driving-scene generation

Song Zhang, Wenxiu Shi, Ruibo Wang, Haiquan Liu, Ziyu Lin, Ruo Jia, Jian Li, Huiping Zhu
article en

Abstract

Synthetic data has emerged as a promising solution for alleviating data scarcity in autonomous driving, especially in cold-start and corner-case scenarios. However, existing synthetic data generation methods still face a trade-off between photorealistic fidelity and engineering scalability. This paper proposes VISTA+, a framework for synthetic driving-scene generation that combines mesh-based single-view novel view synthesis (NVS) of static backgrounds with computer-aided design (CAD)-based foreground rendering and foreground-background composition. Unlike multi-view neural reconstruction methods, VISTA+ avoids large-scale multi-view scene reconstruction, while still requiring camera calibration and source-to-target relative poses, thereby reducing engineering complexity. Specifically, we improve mesh-based background NVS by incorporating foreground inpainting, dense depth supervision, structural pretraining, and joint depth-offset prediction. Dynamic foreground objects are rendered using CAD assets under estimated environmental lighting and are then integrated with generated backgrounds through image harmonization. Experiments on KITTI and nuScenes demonstrate that VISTA+ outperforms representative single-view NVS baselines in terms of peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). Furthermore, synthetic data generated by VISTA+ consistently improves the performance of multiple downstream three-dimensional (3D) object detection models, demonstrating the downstream utility and functional realism of the generated driving scenes.

Journal of Intelligent and Connected Vehicles
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon