EON-1: A Brain-Inspired Processor for Near-Sensor Extreme Edge Online Feature Extraction

For Edge AI applications, deploying online learning and adaptation on resource-constrained embedded devices can deal with low-latency sensor-generated data streams in changing environments. However, since maintaining low-latency and power-efficient inference is paramount at the Edge, online learning and adaptation on the device should impose minimal additional overhead for inference. With this goal in mind, we explore energy-efficient learning and adaptation on-device for streaming-data Edge AI applications using Spiking Neural Networks (SNNs), which follow the principles of brain-inspired computing, such as high-parallelism, neuron co-located memory and compute, and event-driven processing. We propose EON-1, a brain-inspired processor for near-sensor extreme-edge online feature extraction that integrates a fast online learning and adaptation algorithm. We report results of only 1% energy overhead for learning, by far the lowest overhead when compared to other SoTA solutions, while attaining comparable inference accuracy. Furthermore, we demonstrate that EON-1 is up for the challenge of low-latency processing of HD and UHD streaming video in real-time, with learning enabled.

Authors

Institutions

Publication Details

Journal
IEEE transactions on circuits and systems for artificial intelligence.
Published
2024-11-05
DOI
https://doi.org/10.1109/tcasai.2024.3491673
Primary Topic
CCD and CMOS Imaging Sensors
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EON-1: A Brain-Inspired Processor for Near-Sensor Extreme Edge Online Feature Extraction

Said Hamdioui, Mario Konijnenburg, Anteneh Gebregiorgis, Simon J. Thorpe et al.
IEEE transactions on circuits and systems for artificial intelligence.
CCD and CMOS Imaging Sensors
article

EON-1: A Brain-Inspired Processor for Near-Sensor Extreme Edge Online Feature Extraction

Said Hamdioui, Mario Konijnenburg, Anteneh Gebregiorgis, Simon J. Thorpe, Guangzhi Tang, Amirreza Yousefzadeh, Gert-Jan van Schaik, Manolis Sifalakis, Kanishkan Vadivel, Paul Detterer, Alexandra Dobrita
article en

Abstract

For Edge AI applications, deploying online learning and adaptation on resource-constrained embedded devices can deal with low-latency sensor-generated data streams in changing environments. However, since maintaining low-latency and power-efficient inference is paramount at the Edge, online learning and adaptation on the device should impose minimal additional overhead for inference. With this goal in mind, we explore energy-efficient learning and adaptation on-device for streaming-data Edge AI applications using Spiking Neural Networks (SNNs), which follow the principles of brain-inspired computing, such as high-parallelism, neuron co-located memory and compute, and event-driven processing. We propose EON-1, a brain-inspired processor for near-sensor extreme-edge online feature extraction that integrates a fast online learning and adaptation algorithm. We report results of only 1% energy overhead for learning, by far the lowest overhead when compared to other SoTA solutions, while attaining comparable inference accuracy. Furthermore, we demonstrate that EON-1 is up for the challenge of low-latency processing of HD and UHD streaming video in real-time, with learning enabled.

IEEE transactions on circuits and systems for artificial intelligence.Vol. 1(2)
Centre National de la Recherche Scientifique (FR), Université Fédérale de Toulouse Midi-Pyrénées (FR), Imec the Netherlands (NL), Maastricht University (NL), University of Twente (NL), Delft University of Technology (NL)
Key Digital Technologies Joint Undertaking
Openalex Percentile: Top 83%
CCD and CMOS Imaging Sensors
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.