EV-GS: Event-Based Gaussian Splatting for Efficient and Accurate Radiance Field Rendering

Computational neuromorphic imaging (CNI) with event cameras offers advantages such as minimal motion blur and enhanced dynamic range, compared to conventional frame-based methods. Existing event-based radiance field rendering methods are built on neural radiance field, which is computationally heavy and slow in reconstruction speed. Motivated by the two aspects, we introduce Ev-GS, the first CNI-informed scheme to infer 3D Gaussian splatting from a monocular event camera, enabling efficient novel view synthesis. Leveraging 3D Gaussians with pure event-based supervision, Ev-GS overcomes challenges such as the detection of fast-moving objects and insufficient lighting. Experimental results show that Ev-GS outperforms the method that takes frame-based signals as input by rendering realistic views with reduced blurring and improved visual quality. Moreover, it demonstrates competitive reconstruction quality and reduced computing occupancy compared to existing methods, which paves the way to a highly efficient CNI approach for signal processing.

Authors

Institutions

Publication Details

Published
2024-09-22
DOI
https://doi.org/10.1109/mlsp58920.2024.10734753
Citations
9
Primary Topic
Computer Graphics and Visualization Techniques
Type
article
Field-Weighted Citation Impact
5.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EV-GS: Event-Based Gaussian Splatting for Efficient and Accurate Radiance Field Rendering

Edmund Y. M. Lam, Chutian Wang, S. H. Zhu, Jingqian Wu
9 citations
Computer Graphics and Visualization Techniques
5.69
article

EV-GS: Event-Based Gaussian Splatting for Efficient and Accurate Radiance Field Rendering

Edmund Y. M. Lam, Chutian Wang, S. H. Zhu, Jingqian Wu
article en
9 citations

Abstract

Computational neuromorphic imaging (CNI) with event cameras offers advantages such as minimal motion blur and enhanced dynamic range, compared to conventional frame-based methods. Existing event-based radiance field rendering methods are built on neural radiance field, which is computationally heavy and slow in reconstruction speed. Motivated by the two aspects, we introduce Ev-GS, the first CNI-informed scheme to infer 3D Gaussian splatting from a monocular event camera, enabling efficient novel view synthesis. Leveraging 3D Gaussians with pure event-based supervision, Ev-GS overcomes challenges such as the detection of fast-moving objects and insufficient lighting. Experimental results show that Ev-GS outperforms the method that takes frame-based signals as input by rendering realistic views with reduced blurring and improved visual quality. Moreover, it demonstrates competitive reconstruction quality and reduced computing occupancy compared to existing methods, which paves the way to a highly efficient CNI approach for signal processing.

University of Hong Kong (HK)
Affordable and clean energy
Openalex Percentile: Top 3%
Computer Graphics and Visualization Techniques
5.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

EV-GS: Event-Based Gaussian Splatting for Efficient and Accurate Radiance Field Rendering — Edmund Y. M. Lam, Chutian Wang, et al. · (2024) | TGRS Research Map | TGRS