Supervised Learning Algorithm for Deep Spiking Neural Networks Based on Instantaneous Error

In the development of neural networks, BPTT updates the weights by decomposing the time series into consecutive time steps and using a standard backpropagation strategy. Although this approach works well in some cases, it does not fully take into account the importance of temporal localization. To surpass this constraint, this paper innovatively introduces Multi_INSER, a multilayer spiking neural network supervised learning algorithm based on instantaneous error computation. The algorithm breaks through the constraints of traditional algorithms by focusing on the prediction error at the current moment only, and by accurately measuring the discrepancy between the expected and the real result. The gradient descent method is used for immediate weight adjustment, which realizes an efficient optimization strategy based on the instantaneous error gradient. Through a series of spike sequence learning experiments, this paper not only verifies the effectiveness of the Multi_INSER algorithm, but also deeply discusses the key factors affecting its learning performance. The results demonstrate that the algorithm is not only equally matched in terms of performance, but also shows significant advantages in time efficiency.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1109/uemcon62879.2024.10754701
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Supervised Learning Algorithm for Deep Spiking Neural Networks Based on Instantaneous Error

Xiaoqing Fan, Xianghong Lin, Yanan Li
Neural Networks and Applications
article

Supervised Learning Algorithm for Deep Spiking Neural Networks Based on Instantaneous Error

Xiaoqing Fan, Xianghong Lin, Yanan Li
article en

Abstract

In the development of neural networks, BPTT updates the weights by decomposing the time series into consecutive time steps and using a standard backpropagation strategy. Although this approach works well in some cases, it does not fully take into account the importance of temporal localization. To surpass this constraint, this paper innovatively introduces Multi_INSER, a multilayer spiking neural network supervised learning algorithm based on instantaneous error computation. The algorithm breaks through the constraints of traditional algorithms by focusing on the prediction error at the current moment only, and by accurately measuring the discrepancy between the expected and the real result. The gradient descent method is used for immediate weight adjustment, which realizes an efficient optimization strategy based on the instantaneous error gradient. Through a series of spike sequence learning experiments, this paper not only verifies the effectiveness of the Multi_INSER algorithm, but also deeply discusses the key factors affecting its learning performance. The results demonstrate that the algorithm is not only equally matched in terms of performance, but also shows significant advantages in time efficiency.

Northwest Normal University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 81%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.