High-efficiency 3D Gaussian splatting rendering assisted by event signal sampling

3D Gaussian Splatting has marked a significant milestone in novel view synthesis, particularly in the real-time level rendering speed. Despite its remarkable contributions, this technique encounters substantial challenges when reconstructing dynamic scenes due to motion blur, which leads to inaccurate point clouds and low-resolution vision performance. To address this issue, this paper proposes an event camera assisting 3D Gaussian Splatting generation, which provides high-accuracy vision cues for reliable motion description. Because moving objects attract more attention, the entire scene is rendered at different precision scales. Specifically, the proposed solution provides a detailed rendering of the space captured by the event camera and reduces its rendering accuracy for static backgrounds. Our comparative experiments demonstrate that the adoption of event camera imagery significantly improves the fidelity of the novel view synthesis, thereby enhancing the overall reconstruction quality in dynamic scenes.

Authors

Institutions

Publication Details

Published
2024-11-23
DOI
https://doi.org/10.1117/12.3036997
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

High-efficiency 3D Gaussian splatting rendering assisted by event signal sampling

Jiayu Yang, Xiaoqing Zuo, Yu Qi Han
Image and Video Quality Assessment
article

High-efficiency 3D Gaussian splatting rendering assisted by event signal sampling

Jiayu Yang, Xiaoqing Zuo, Yu Qi Han
article en

Abstract

3D Gaussian Splatting has marked a significant milestone in novel view synthesis, particularly in the real-time level rendering speed. Despite its remarkable contributions, this technique encounters substantial challenges when reconstructing dynamic scenes due to motion blur, which leads to inaccurate point clouds and low-resolution vision performance. To address this issue, this paper proposes an event camera assisting 3D Gaussian Splatting generation, which provides high-accuracy vision cues for reliable motion description. Because moving objects attract more attention, the entire scene is rendered at different precision scales. Specifically, the proposed solution provides a detailed rendering of the space captured by the event camera and reduces its rendering accuracy for static backgrounds. Our comparative experiments demonstrate that the adoption of event camera imagery significantly improves the fidelity of the novel view synthesis, thereby enhancing the overall reconstruction quality in dynamic scenes.

Dalian University of Technology (CN)
Affordable and clean energy
Openalex Percentile: Top 79%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.