Catastrophic forgetting as a dynamical phenomenon: Understanding parameter evolution under sequential task exposure

Catastrophic forgetting occurs when performance on previously learned tasks deteriorates during sequential training. We examine whether the temporal organization of task exposure influences forgetting and whether properties of the schedule generator predict learning outcomes. Sequential learning is formulated as a forced optimization process, and periodic, balanced-random, and three logistic-map schedules are compared across Split MNIST, Permuted MNIST, and Split CIFAR-10. Using five paired seeds, we analyze terminal accuracy and forgetting alongside exposure-gap associations, autocorrelation, spectral entropy, and recurrence measures. Descriptive outcome differences are largest in Split MNIST, negligible at the end of the near-ceiling Permuted-MNIST experiment, and modest for terminal accuracy but larger for terminal forgetting in Split CIFAR-10. However, none of the comparisons remained significant after Holm correction. Holm-adjusted temporal tests identify differences in inactive-task gap–forgetting associations and recurrence measures in Split MNIST and in autocorrelation, spectral entropy, and recurrence measures in Split CIFAR-10, but no adjusted temporal differences in Permuted MNIST. Increasing positive Lyapunov exponents of the logistic-map generators do not correspond monotonically to forgetting. Learning-rate, mitigation-method, and architecture analyses further reveal condition-dependent accuracy–retention trade-offs. Overall, temporal exposure structure influences sequential-learning behavior, but its effects depend on the task setting, optimization, and model configuration rather than following a universal periodic–random–chaotic ordering.

Authors

Institutions

Publication Details

Journal
Intelligent Data Analysis
Published
2026-09-21
DOI
https://doi.org/10.1177/1088467x261491030
Primary Topic
Motor Control and Adaptation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Catastrophic forgetting as a dynamical phenomenon: Understanding parameter evolution under sequential task exposure

Dariusz Jemielniak, Amin Mahmoudi
Intelligent Data Analysis
Motor Control and Adaptation
article

Catastrophic forgetting as a dynamical phenomenon: Understanding parameter evolution under sequential task exposure

Dariusz Jemielniak, Amin Mahmoudi
article en

Abstract

Catastrophic forgetting occurs when performance on previously learned tasks deteriorates during sequential training. We examine whether the temporal organization of task exposure influences forgetting and whether properties of the schedule generator predict learning outcomes. Sequential learning is formulated as a forced optimization process, and periodic, balanced-random, and three logistic-map schedules are compared across Split MNIST, Permuted MNIST, and Split CIFAR-10. Using five paired seeds, we analyze terminal accuracy and forgetting alongside exposure-gap associations, autocorrelation, spectral entropy, and recurrence measures. Descriptive outcome differences are largest in Split MNIST, negligible at the end of the near-ceiling Permuted-MNIST experiment, and modest for terminal accuracy but larger for terminal forgetting in Split CIFAR-10. However, none of the comparisons remained significant after Holm correction. Holm-adjusted temporal tests identify differences in inactive-task gap–forgetting associations and recurrence measures in Split MNIST and in autocorrelation, spectral entropy, and recurrence measures in Split CIFAR-10, but no adjusted temporal differences in Permuted MNIST. Increasing positive Lyapunov exponents of the logistic-map generators do not correspond monotonically to forgetting. Learning-rate, mitigation-method, and architecture analyses further reveal condition-dependent accuracy–retention trade-offs. Overall, temporal exposure structure influences sequential-learning behavior, but its effects depend on the task setting, optimization, and model configuration rather than following a universal periodic–random–chaotic ordering.

Intelligent Data Analysis
Kozminski University (PL)
Openalex Percentile: Top 9%
Motor Control and Adaptation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Catastrophic forgetting as a dynamical phenomenon: Understanding parameter evolution under sequential task exposure — Dariusz Jemielniak, Amin Mahmoudi · Intelligent Data Analysis (2026) | TGRS Research Map | TGRS