A Distributed Time-of-Flight Sensor System for Autonomous Vehicles: Architecture, Sensor Fusion, and Spiking Neural Network Perception
Mechanically scanning LiDAR imaging sensors are abundantly used in applications ranging from basic safety assistance to high-level automated driving, offering excellent spatial resolution and full surround-view coverage in most scenarios. However, their complex optomechanical structure introduces limitations, namely limited mounting options and blind zones, especially in elongated vehicles. To mitigate these challenges, we propose a distributed Time-of-Flight (ToF) sensor system with a flexible hardware–software architecture designed for multi-sensor synchronous triggering and fusion. We formalize the sensor triggering, interference mitigation scheme, data aggregation and fusion procedures and highlight challenges in achieving accurate global registration with current state-of-the-art methods. The resulting surround view visual information is then applied to Spiking Neural Network (SNN)-based object detection and probabilistic occupancy grid mapping (OGM) for enhanced environmental awareness. The proposed system is demonstrated on a test vehicle, achieving coverage of blind zones in a range of 0.5–6 m with a scalable and reconfigurable sensor mounting setup. Using seven ToF sensors, we can achieve a 10 Hz synchronized frame rate, with a 360° point cloud registration and fusion latency below 40 ms. We collected real-world driving data to evaluate the system, achieving 65% mean Average Precision (mAP) in object detection with our SNN. Overall, this work presents a replacement or addition to LiDAR in future high-level automation tasks, offering improved coverage and system integration.
Authors
- George Dimitrakopoulos (ORCID: https://orcid.org/0000-0002-7424-8557)
- Andrejs Cvetkovs (ORCID: https://orcid.org/0000-0002-8579-9813)
- Jochen Koszescha
- Anatolijs Zencovs (ORCID: https://orcid.org/0000-0001-6255-1674)
- Rihards Novickis (ORCID: https://orcid.org/0000-0001-8585-1821)
- Edgars Lielāmurs (ORCID: https://orcid.org/0000-0001-5880-2186)
- Kaspars Ozols (ORCID: https://orcid.org/0000-0002-9009-7306)
- Andis Bizuns (ORCID: https://orcid.org/0000-0002-1298-7071)
- Maksis Celitans (ORCID: https://orcid.org/0000-0002-7980-5981)
- Ibrahim Sayed
Institutions
- Infineon Technologies (Germany) (DE)
- Institute of Electronics and Computer Science (LV)
Publication Details
- Journal
- Electronics
- Published
- 2025-03-29
- DOI
- https://doi.org/10.3390/electronics14071375
- Citations
- 4
- Primary Topic
- Target Tracking and Data Fusion in Sensor Networks
- Type
- article
- Field-Weighted Citation Impact
- 9.92
Funders
- HORIZON EUROPE Framework Programme