NEXUS: A 28nm 3.3pJ/SOP 16-Core Spiking Neural Network With a Diamond Topology for Real-Time Data Processing

The realization of brain-scale spiking neural networks (SNNs) is impeded by power constraints and low integration density. To address these challenges, multi-core SNNs are utilized to emulate numerous neurons with high energy efficiency, where spike packets are routed through a network-on-chip (NoC). However, the information can be lost in the NoC under high spike traffic conditions, leading to performance degradation. This work presents NEXUS, a 16-core SNN with a diamond-shaped NoC topology fabricated in 28-nm CMOS technology. It integrates 4096 leaky integrate-and-fire (LIF) neurons with 1M 4-bit synaptic weights, occupying an area of 2.16 mm<sup>2</sup>. The proposed NoC architecture is scalable to any network size, ensuring no data loss due to contending packets with a maximum routing latency of 5.1$\mu$s for 16 cores. The proposed congestion management method eliminates the need for FIFO in routers, resulting in a compact router footprint of 0.001 mm<sup>2</sup>. The proposed neurosynaptic core allows for increasing the processing speed by up to 8.5$\times$ depending on input sparsity. The SNN achieves a peak throughput of 4.7 GSOP/s at 0.9 V, consuming a minimum energy per synaptic operation (SOP) of 3.3 pJ at 0.55 V. A 4-layer feed-forward network is mapped onto the chip, classifying MNIST digits with 92.3% accuracy at 8.4K-classification/s and consuming 2.7-$\mu$J/classification. Additionally, an audio recognition task mapped onto the chip achieves 87.4% accuracy at 215-$\mu$J/classification.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Biomedical Circuits and Systems
Published
2024-08-30
DOI
https://doi.org/10.1109/tbcas.2024.3452635
Citations
4
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.83

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NEXUS: A 28nm 3.3pJ/SOP 16-Core Spiking Neural Network With a Diamond Topology for Real-Time Data Processing

Yasser Rezaeiyan, Farshad Moradi, Federico Corradi, Charles Augustine et al.
4 citations
IEEE Transactions on Biomedical Circuits and Systems
Advanced Memory and Neural Computing
0.83
article

NEXUS: A 28nm 3.3pJ/SOP 16-Core Spiking Neural Network With a Diamond Topology for Real-Time Data Processing

Yasser Rezaeiyan, Farshad Moradi, Federico Corradi, Charles Augustine, Dario Fernandez Khatiboun, Maryam Sadeghi, Sherif Eissa
article en
4 citations

Abstract

The realization of brain-scale spiking neural networks (SNNs) is impeded by power constraints and low integration density. To address these challenges, multi-core SNNs are utilized to emulate numerous neurons with high energy efficiency, where spike packets are routed through a network-on-chip (NoC). However, the information can be lost in the NoC under high spike traffic conditions, leading to performance degradation. This work presents NEXUS, a 16-core SNN with a diamond-shaped NoC topology fabricated in 28-nm CMOS technology. It integrates 4096 leaky integrate-and-fire (LIF) neurons with 1M 4-bit synaptic weights, occupying an area of 2.16 mm<sup>2</sup>. The proposed NoC architecture is scalable to any network size, ensuring no data loss due to contending packets with a maximum routing latency of 5.1$\mu$s for 16 cores. The proposed congestion management method eliminates the need for FIFO in routers, resulting in a compact router footprint of 0.001 mm<sup>2</sup>. The proposed neurosynaptic core allows for increasing the processing speed by up to 8.5$\times$ depending on input sparsity. The SNN achieves a peak throughput of 4.7 GSOP/s at 0.9 V, consuming a minimum energy per synaptic operation (SOP) of 3.3 pJ at 0.55 V. A 4-layer feed-forward network is mapped onto the chip, classifying MNIST digits with 92.3% accuracy at 8.4K-classification/s and consuming 2.7-$\mu$J/classification. Additionally, an audio recognition task mapped onto the chip achieves 87.4% accuracy at 215-$\mu$J/classification.

IEEE Transactions on Biomedical Circuits and SystemsVol. 19(3)
Intel (United States) (US), Aarhus University (DK), Eindhoven University of Technology (NL)
Innovationsfonden
Openalex Percentile: Top 27%
Advanced Memory and Neural Computing
0.83
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.