SpELL: a fully spiking event-based eye-tracking network for neuromorphic hardware
Eye tracking is a crucial task for smart eyewear; however, conventional frame-based pipelines are costly for always-on settings because they rely on dense image acquisition and processing. Event cameras and spiking neural networks (SNNs) provide a promising alternative; however, practical embedded eye tracking remains limited by the difficulty of regressing continuous pupil coordinates from sparse spikes and the gap between off-chip training and neuromorphic deployment. This paper presents SpELL, fully Spiking Eye-tracking at Low Latency, a fully spiking event-based eye-tracking framework for neuromorphic hardware. The proposed system combines a fully hardware-compatible SNN for direct pupil-center estimation and a preprocessing stage that controls event throughput. The method is evaluated on the Angelopoulos, Ini-30, and 3ET+ datasets and deployed on the SPECK neuromorphic processor. Off-chip, SpELL achieves a mean error of 2.83 px across the three datasets. On-chip, SpELL achieves competitive tracking accuracy with SPECK chip power consumption as low as 2 mW, excluding the external processing used for input regulation and output readout. These results demonstrate the potential of fully spiking inference for low-power eye tracking in wearable event-based vision systems.
Authors
- Matteo Matteucci (ORCID: https://orcid.org/0000-0002-8306-6739)
- Marco Cannici (ORCID: https://orcid.org/0000-0002-9217-3552)
- Luca Merigo (ORCID: https://orcid.org/0009-0001-5954-426X)
- Simone Mentasti (ORCID: https://orcid.org/0000-0001-7059-413X)
- Andrea Simpsi (ORCID: https://orcid.org/0000-0002-2700-4808)
- Andrea Aspesi (ORCID: https://orcid.org/0009-0000-4936-5973)
- Aaron Tognoli (ORCID: https://orcid.org/0009-0008-1429-7171)
- Lorenzo Franzè (ORCID: https://orcid.org/0009-0008-0341-079X)
Institutions
- Luxottica (Italy) (IT)
Publication Details
- Journal
- Neuromorphic Computing and Engineering
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1088/2634-4386/aeb8b9
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00