3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration
Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless, such methods are inherently slow to train given the high computational overhead caused by the large number of sampled points required for volume rendering. With the recent introduction of 3D Gaussian Splatting as a faster alternative to implicit representation methods, we propose to leverage this new rendering approach to achieve faster multi-sensor calibration. We introduce 3DGS-Calib, a new calibration method that relies on the speed and rendering accuracy of 3D Gaussian Splatting to achieve multimodal spatiotemporal calibration that is accurate, robust, and with a substantial speed-up compared to methods relying on implicit neural representations. We demonstrate the superiority of our proposal with experimental results on sequences from KITTI-360, a widely used driving dataset.
Authors
- Moussâb Bennehar (ORCID: https://orcid.org/0000-0002-6566-6132)
- Pascal Vasseur (ORCID: https://orcid.org/0000-0001-5145-9653)
- Quentin Herau (ORCID: https://orcid.org/0009-0001-4875-9492)
- Arthur Moreau
- Cyrille Migniot (ORCID: https://orcid.org/0000-0002-1651-4837)
- Luis Roldão (ORCID: https://orcid.org/0000-0003-0482-3584)
- Nathan Piasco (ORCID: https://orcid.org/0000-0001-7952-6643)
- Dzmitry Tsishkou (ORCID: https://orcid.org/0009-0002-9798-3316)
- Cédric Demonceaux (ORCID: https://orcid.org/0000-0001-6916-1273)
Institutions
- Centre National de la Recherche Scientifique (FR)
- Université de Bourgogne (FR)
- Huawei Technologies (France) (FR)
- Hôpital Saint-Michel (FR)
- Huawei Technologies (United Kingdom) (GB)
- ImViA - Imagerie et Vision Artificielle (FR)
- Vision pour la Robotique (FR)
- Modélisation, information et systèmes (FR)
- Centre de Robotique
- Université de Picardie Jules Verne (FR)
Publication Details
- Published
- 2024-10-14
- DOI
- https://doi.org/10.1109/iros58592.2024.10801360
- Citations
- 6
- Primary Topic
- Robotics and Sensor-Based Localization
- Type
- article
- Field-Weighted Citation Impact
- 7.79