PLASTICITY-AWARE SPIKING TRANSFORMERS: A NEUROCOMPUTATIONAL FRAMEWORK FOR LOW-POWER CONTINUAL LEARNING IN DYNAMIC ENVIRONMENTS

Real-time intelligent systems operating in dynamic environments require the capacity for continual learning, low power consumption, and biologically inspired adaptability. This paper introduces Plasticity-Aware Spiking Transformers (PAST)—a neurocomputational architecture that fuses spiking neural networks (SNNs) with temporal attention transformers, enriched by plasticity-driven learning and adaptive memory modules. Designed for deployment on neuromorphic hardware, PAST models mimic the human brain's energy-efficient mechanisms to perform continual learning with minimal catastrophic forgetting. Experimental results show that PAST achieves significant improvements in accuracy, energy consumption, and adaptation compared to conventional deep learning models across dynamic benchmarks like Split-CIFAR, DVS Gesture, and Permuted MNIST.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-06-17
DOI
https://doi.org/10.5281/zenodo.15682359
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PLASTICITY-AWARE SPIKING TRANSFORMERS: A NEUROCOMPUTATIONAL FRAMEWORK FOR LOW-POWER CONTINUAL LEARNING IN DYNAMIC ENVIRONMENTS

Zenodo (CERN European Organization for Nuclear Research)
Advanced Memory and Neural Computing
article

PLASTICITY-AWARE SPIKING TRANSFORMERS: A NEUROCOMPUTATIONAL FRAMEWORK FOR LOW-POWER CONTINUAL LEARNING IN DYNAMIC ENVIRONMENTS

article en

Abstract

Real-time intelligent systems operating in dynamic environments require the capacity for continual learning, low power consumption, and biologically inspired adaptability. This paper introduces Plasticity-Aware Spiking Transformers (PAST)—a neurocomputational architecture that fuses spiking neural networks (SNNs) with temporal attention transformers, enriched by plasticity-driven learning and adaptive memory modules. Designed for deployment on neuromorphic hardware, PAST models mimic the human brain's energy-efficient mechanisms to perform continual learning with minimal catastrophic forgetting. Experimental results show that PAST achieves significant improvements in accuracy, energy consumption, and adaptation compared to conventional deep learning models across dynamic benchmarks like Split-CIFAR, DVS Gesture, and Permuted MNIST.

Zenodo (CERN European Organization for Nuclear Research)
Affordable and clean energy
Openalex Percentile: Top 56%
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.