Data-Free Continual Learning in a Spiking Network via Targeted Sleep Consolidation and Protection-Aware Normalization: A Pre-registered Evaluation

Neural networks forget earlier tasks when trained on new ones. Regularization methods such as Elastic Weight Consolidation (EWC) reduce forgetting at the cost of plasticity, and replay methods store past data. We study a brain-inspired spiking network that learns a sequence of lessons with spike-timing-dependent plasticity and stores no training data. After each lesson an offline “sleep” phase consolidates only the synapses leaving each stored memory’s input cells, and a protection-aware synaptic normalization excludes the protected part of every synapse from competition. Every confirmatory hypothesis was pre-registered in version control and tested on held-out random seeds. On five sequential digit pairs of MNIST, the method reached 54.7% ten-class accuracy versus 36.4% for EWC whose strength was tuned on MNIST itself (+18.3 points, 10/10 seeds); the advantage held under ten random task orders (+17.1, 10/10) and for a variant that selects memories from lesson activity without labels. Removing protection-aware normalization alone reduced accuracy by 22.1 points. On Fashion-MNIST, with no re-tuning of our method, the advantage over a re-tuned EWC persisted but was much smaller (+4.5 points, 9/10 seeds), and the label-free variant was the best method (51.6%). Absolute accuracy remains below a raw-pixel nearest-class-mean reference (73.5% and 62.2%), so our claims concern the relative behaviour of sequential learners under identical constraints. We report negative results, including an apparent theta-rhythm benefit that a matched control traced to extra learning time.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-29
DOI
https://doi.org/10.5281/zenodo.23779408
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Data-Free Continual Learning in a Spiking Network via Targeted Sleep Consolidation and Protection-Aware Normalization: A Pre-registered Evaluation

Khalid Khalid
Zenodo (CERN European Organization for Nuclear Research)
Domain Adaptation and Few-Shot Learning
preprint

Data-Free Continual Learning in a Spiking Network via Targeted Sleep Consolidation and Protection-Aware Normalization: A Pre-registered Evaluation

Khalid Khalid
preprint en

Abstract

Neural networks forget earlier tasks when trained on new ones. Regularization methods such as Elastic Weight Consolidation (EWC) reduce forgetting at the cost of plasticity, and replay methods store past data. We study a brain-inspired spiking network that learns a sequence of lessons with spike-timing-dependent plasticity and stores no training data. After each lesson an offline “sleep” phase consolidates only the synapses leaving each stored memory’s input cells, and a protection-aware synaptic normalization excludes the protected part of every synapse from competition. Every confirmatory hypothesis was pre-registered in version control and tested on held-out random seeds. On five sequential digit pairs of MNIST, the method reached 54.7% ten-class accuracy versus 36.4% for EWC whose strength was tuned on MNIST itself (+18.3 points, 10/10 seeds); the advantage held under ten random task orders (+17.1, 10/10) and for a variant that selects memories from lesson activity without labels. Removing protection-aware normalization alone reduced accuracy by 22.1 points. On Fashion-MNIST, with no re-tuning of our method, the advantage over a re-tuned EWC persisted but was much smaller (+4.5 points, 9/10 seeds), and the label-free variant was the best method (51.6%). Absolute accuracy remains below a raw-pixel nearest-class-mean reference (73.5% and 62.2%), so our claims concern the relative behaviour of sequential learners under identical constraints. We report negative results, including an apparent theta-rhythm benefit that a matched control traced to extra learning time.

Zenodo (CERN European Organization for Nuclear Research)
King Faisal University (SA)
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Data-Free Continual Learning in a Spiking Network via Targeted Sleep Consolidation and Protection-Aware Normalization: A Pre-registered Evaluation — Khalid Khalid · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS