Novel View Synthesis Under Large-Deviation Viewpoint for Autonomous Driving
Novel view synthesis is a critical task in autonomous driving. Although 3D Gaussian Splatting (3D-GS) has shown success in generating novel views, it faces challenges in maintaining high-quality rendering when viewpoints deviate significantly from the training set. This difficulty primarily stems from complex lighting conditions and geometric inconsistencies in texture-less regions. To address these issues, we propose an attention-based illumination model that leverages light fields from neighboring views, enhancing the realism of synthesized images. Additionally, we propose a geometry optimization method using planar homography to improve geometric consistency in texture-less regions. Our experiments demonstrate substantial improvements in synthesis quality for large-deviation viewpoints, validating the effectiveness of our approach.
Authors
- Shibiao Xu (ORCID: https://orcid.org/0000-0003-4037-9900)
- Xin Ma (ORCID: https://orcid.org/0000-0002-7316-1468)
- Peng Lü (ORCID: https://orcid.org/0000-0002-0190-6395)
- Chengwei Pan
- Jiguang Zhang
Institutions
- Beijing University of Posts and Telecommunications (CN)
- Institute of Automation (CN)
- Beihang University (CN)
Publication Details
- Journal
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2025-04-11
- DOI
- https://doi.org/10.1609/aaai.v39i6.32641
- Primary Topic
- Simulation and Modeling Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00