Neuromorphic Motion Segmentation with Spiking Neural Networks for Robotic Perception

Event-based cameras have emerged as a promising technology for robotic applications, offering high temporal resolution and low latency. Motion segmentation is a critical task for dynamic environments, enabling essential capabilities such as obstacle avoidance, SLAM, and autonomous navigation. In this work, we propose a spiking neural network (SNN) architecture based on a U-Net encoder-decoder to perform motion segmentation using event streams captured by event-based cameras. The network processes spatio-temporal data efficiently and is trained with a combination of Dice loss and binary cross-entropy to handle imbalanced segmentation masks. We leverage the EVIMO dataset, which provides pixel-wise motion labels, egomotion data, and event streams, to train and evaluate the model. Our method achieves an Intersection over Union (IoU) score of 51 . 6%, comparable to state-of-the-art approaches like SpikeMS, while maintaining computational efficiency. Qualitative results show accurate pixel-wise segmentation of dynamic objects, demonstrating clear visual alignment between the predictions and the ground truth. These results highlight the potential of our approach for deployment in neu-romorphic robotic systems requiring real-time processing.

Authors

Institutions

Publication Details

Journal
IFAC-PapersOnLine
Published
2025-01-01
DOI
https://doi.org/10.1016/j.ifacol.2025.10.184
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Neuromorphic Motion Segmentation with Spiking Neural Networks for Robotic Perception

Daniela Esparza, Gerardo Flores, Sergio Trejo
IFAC-PapersOnLine
Advanced Memory and Neural Computing
article

Neuromorphic Motion Segmentation with Spiking Neural Networks for Robotic Perception

Daniela Esparza, Gerardo Flores, Sergio Trejo
article en

Abstract

Event-based cameras have emerged as a promising technology for robotic applications, offering high temporal resolution and low latency. Motion segmentation is a critical task for dynamic environments, enabling essential capabilities such as obstacle avoidance, SLAM, and autonomous navigation. In this work, we propose a spiking neural network (SNN) architecture based on a U-Net encoder-decoder to perform motion segmentation using event streams captured by event-based cameras. The network processes spatio-temporal data efficiently and is trained with a combination of Dice loss and binary cross-entropy to handle imbalanced segmentation masks. We leverage the EVIMO dataset, which provides pixel-wise motion labels, egomotion data, and event streams, to train and evaluate the model. Our method achieves an Intersection over Union (IoU) score of 51 . 6%, comparable to state-of-the-art approaches like SpikeMS, while maintaining computational efficiency. Qualitative results show accurate pixel-wise segmentation of dynamic objects, demonstrating clear visual alignment between the predictions and the ground truth. These results highlight the potential of our approach for deployment in neu-romorphic robotic systems requiring real-time processing.

IFAC-PapersOnLineVol. 59(17)
Texas A&M International University (US), Centro de Investigaciones en Optica (MX)
Openalex Percentile: Top 68%
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.