Transient times and cycle-rich topology in reservoir computing

Training in reservoir computing (RC) requires using an initial part of the input sequence for the reservoir internal state to synchronize with the driver. The length of this transient, often treated as an empirical washout parameter, is a critical resource: too short and training fails, too long and data are wasted. These synchronization transients are quantified and explain when and why they become prohibitively long. For spectral radius ρ<1 (the largest absolute eigenvalue of the recurrent weight matrix), a closed-form upper bound is derived from the linearized dynamics that captures the dependence on tolerance and typical initial separation. Near and above unity, ensemble experiments reveal heavy-tailed transient-time distributions: most realizations synchronize quickly, yet a non-negligible fraction requires orders of magnitude longer washout. Non-linear saturation under driving shortens transients and can restore the Echo State Property even for ρ>1, with rates controlled by input amplitude and leakage. At zero input, persistence vs silence is dictated by topology: interpreting the recurrent weight matrix A as a directed graph and decomposing it into cycles explains which nodes sustain activity (core), which inherit it downstream (driven), and which die out (quiescent). This structure-dynamics correspondence yields practical design rules: pre-screen reservoirs by monitoring state distances; favor cycle-rich topologies or nodes downstream of cycles; avoid very sparse or very dense regimes at large ρ; and tune input scaling/leakage to exploit saturation. Overall, this turns "washout" from a heuristic into a measurable, engineerable property with clear levers for robust, data-efficient RC.

Authors

Institutions

Publication Details

Journal
Chaos An Interdisciplinary Journal of Nonlinear Science
Published
2026-04-01
DOI
https://doi.org/10.1063/5.0302415
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transient times and cycle-rich topology in reservoir computing

Daniel Estévez-Moya, Hölger Kantz, Erick Alejandro Madrigal Solis, Misha Chai et al.
Chaos An Interdisciplinary Journal of Nonlinear Science
Neural Networks and Reservoir Computing
article

Transient times and cycle-rich topology in reservoir computing

Daniel Estévez-Moya, Hölger Kantz, Erick Alejandro Madrigal Solis, Misha Chai, Ernesto Estevez-Rams
article en

Abstract

Training in reservoir computing (RC) requires using an initial part of the input sequence for the reservoir internal state to synchronize with the driver. The length of this transient, often treated as an empirical washout parameter, is a critical resource: too short and training fails, too long and data are wasted. These synchronization transients are quantified and explain when and why they become prohibitively long. For spectral radius ρ<1 (the largest absolute eigenvalue of the recurrent weight matrix), a closed-form upper bound is derived from the linearized dynamics that captures the dependence on tolerance and typical initial separation. Near and above unity, ensemble experiments reveal heavy-tailed transient-time distributions: most realizations synchronize quickly, yet a non-negligible fraction requires orders of magnitude longer washout. Non-linear saturation under driving shortens transients and can restore the Echo State Property even for ρ>1, with rates controlled by input amplitude and leakage. At zero input, persistence vs silence is dictated by topology: interpreting the recurrent weight matrix A as a directed graph and decomposing it into cycles explains which nodes sustain activity (core), which inherit it downstream (driven), and which die out (quiescent). This structure-dynamics correspondence yields practical design rules: pre-screen reservoirs by monitoring state distances; favor cycle-rich topologies or nodes downstream of cycles; avoid very sparse or very dense regimes at large ρ; and tune input scaling/leakage to exploit saturation. Overall, this turns "washout" from a heuristic into a measurable, engineerable property with clear levers for robust, data-efficient RC.

Chaos An Interdisciplinary Journal of Nonlinear ScienceVol. 36(4)
University of Havana (CU), Max Planck Institute for the Physics of Complex Systems (DE)
Openalex Percentile: Top 25%
Neural Networks and Reservoir Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.