Fast Exploration of the Impact of Precision Reduction on Spiking Neural Networks

Approximate Computing (AxC) techniques trade off computational accuracy for gains in performance, energy efficiency, and area reduction. This trade-off is particularly advantageous when applications, like Spiking Neural Networks (SNNs), are naturally tolerant to some degree of accuracy loss. SNNs are especially practical when the target hardware is pushed to the edge of its computing capabilities, necessitating area minimization strategies. In this work, we utilize an Interval Arithmetic (IA)-based model that propagates approximation errors through the application’s computation flow to assess these approximations' impact on the outputs. We enhance this IA-based model by introducing observation points within the computation flow to quickly detect when the level of approximation surpasses a set threshold. Experimental results demonstrate the model’s effectiveness in significantly reducing exploration time, enabling more precise and fine-grained approximations that further minimize network parameters.

Authors

Institutions

Publication Details

Published
2024-10-14
DOI
https://doi.org/10.1109/dttis62212.2024.10780090
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fast Exploration of the Impact of Precision Reduction on Spiking Neural Networks

Alessio Carpegna, Stefano Di Carlo, Alessandro Savino, Sepide Saeedi
Advanced Memory and Neural Computing
article

Fast Exploration of the Impact of Precision Reduction on Spiking Neural Networks

Alessio Carpegna, Stefano Di Carlo, Alessandro Savino, Sepide Saeedi
article en

Abstract

Approximate Computing (AxC) techniques trade off computational accuracy for gains in performance, energy efficiency, and area reduction. This trade-off is particularly advantageous when applications, like Spiking Neural Networks (SNNs), are naturally tolerant to some degree of accuracy loss. SNNs are especially practical when the target hardware is pushed to the edge of its computing capabilities, necessitating area minimization strategies. In this work, we utilize an Interval Arithmetic (IA)-based model that propagates approximation errors through the application’s computation flow to assess these approximations' impact on the outputs. We enhance this IA-based model by introducing observation points within the computation flow to quickly detect when the level of approximation surpasses a set threshold. Experimental results demonstrate the model’s effectiveness in significantly reducing exploration time, enabling more precise and fine-grained approximations that further minimize network parameters.

Politecnico di Torino (IT)
Openalex Percentile: Top 79%
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.