EON-1: A Brain-Inspired Processor for Near-Sensor Extreme Edge Online Feature Extraction
For Edge AI applications, deploying online learning and adaptation on resource-constrained embedded devices can deal with low-latency sensor-generated data streams in changing environments. However, since maintaining low-latency and power-efficient inference is paramount at the Edge, online learning and adaptation on the device should impose minimal additional overhead for inference. With this goal in mind, we explore energy-efficient learning and adaptation on-device for streaming-data Edge AI applications using Spiking Neural Networks (SNNs), which follow the principles of brain-inspired computing, such as high-parallelism, neuron co-located memory and compute, and event-driven processing. We propose EON-1, a brain-inspired processor for near-sensor extreme-edge online feature extraction that integrates a fast online learning and adaptation algorithm. We report results of only 1% energy overhead for learning, by far the lowest overhead when compared to other SoTA solutions, while attaining comparable inference accuracy. Furthermore, we demonstrate that EON-1 is up for the challenge of low-latency processing of HD and UHD streaming video in real-time, with learning enabled.
Authors
- Said Hamdioui (ORCID: https://orcid.org/0000-0002-8961-0387)
- Mario Konijnenburg (ORCID: https://orcid.org/0000-0001-8016-0888)
- Anteneh Gebregiorgis (ORCID: https://orcid.org/0000-0002-8408-5691)
- Simon J. Thorpe (ORCID: https://orcid.org/0000-0003-4997-3367)
- Guangzhi Tang (ORCID: https://orcid.org/0000-0002-0204-9225)
- Amirreza Yousefzadeh (ORCID: https://orcid.org/0000-0002-2967-5090)
- Gert-Jan van Schaik
- Manolis Sifalakis (ORCID: https://orcid.org/0000-0002-0949-2094)
- Kanishkan Vadivel (ORCID: https://orcid.org/0000-0003-4186-9530)
- Paul Detterer (ORCID: https://orcid.org/0000-0001-9329-1721)
- Alexandra Dobrita
Institutions
- Centre National de la Recherche Scientifique (FR)
- Université Fédérale de Toulouse Midi-Pyrénées (FR)
- Imec the Netherlands (NL)
- Maastricht University (NL)
- University of Twente (NL)
- Delft University of Technology (NL)
Publication Details
- Journal
- IEEE transactions on circuits and systems for artificial intelligence.
- Published
- 2024-11-05
- DOI
- https://doi.org/10.1109/tcasai.2024.3491673
- Primary Topic
- CCD and CMOS Imaging Sensors
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Key Digital Technologies Joint Undertaking