An Improved Algorithm for Spiking Neural Networks with Multi-Scale Attention Coding

Spiking Neural Networks (SNNs), driven by spike-based mechanisms, are known for their high efficiency and low energy consumption, which makes them ideal for applications like image classification, object detection, and medical diagnostics. However, challenges include training difficulties due to the non-differentiability of spiking activities and limitations in encoding schemes, which struggle to capture complex spatio-temporal dynamics. In this paper, we propose a novel algorithm, termed the Spatio-Temporal Backpropagation algorithm with Multi-Scale Attention Coding (STBP-MSC). STBP-MSC dynamically allocates attention across spatial and temporal domains, which improves coding efficiency and enhances the classification accuracy of SNNs. Furthermore, STBP-MSC incorporates the Complementary Leaky Integrate-and-Fire (CLIF) neuron model, which enhances temporal gradient computation. Experimental results on the MNIST and Fashion-MNIST datasets demonstrate that STBP-MSC achieves high coding efficiency and superior performance within minimal time windows.

Authors

Institutions

Publication Details

Published
2024-11-08
DOI
https://doi.org/10.1109/iccsi62669.2024.10799456
Citations
1
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.21

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Improved Algorithm for Spiking Neural Networks with Multi-Scale Attention Coding

Xiaofeng Chen, Sisi Chen, Weikai Li
1 citations
Advanced Memory and Neural Computing
0.21
article

An Improved Algorithm for Spiking Neural Networks with Multi-Scale Attention Coding

Xiaofeng Chen, Sisi Chen, Weikai Li
article en
1 citations

Abstract

Spiking Neural Networks (SNNs), driven by spike-based mechanisms, are known for their high efficiency and low energy consumption, which makes them ideal for applications like image classification, object detection, and medical diagnostics. However, challenges include training difficulties due to the non-differentiability of spiking activities and limitations in encoding schemes, which struggle to capture complex spatio-temporal dynamics. In this paper, we propose a novel algorithm, termed the Spatio-Temporal Backpropagation algorithm with Multi-Scale Attention Coding (STBP-MSC). STBP-MSC dynamically allocates attention across spatial and temporal domains, which improves coding efficiency and enhances the classification accuracy of SNNs. Furthermore, STBP-MSC incorporates the Complementary Leaky Integrate-and-Fire (CLIF) neuron model, which enhances temporal gradient computation. Experimental results on the MNIST and Fashion-MNIST datasets demonstrate that STBP-MSC achieves high coding efficiency and superior performance within minimal time windows.

Chongqing Jiaotong University (CN)
National Natural Science Foundation of China, Natural Science Foundation of Chongqing, Chongqing Municipal Education Commission
Openalex Percentile: Top 45%
Advanced Memory and Neural Computing
0.21
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.