Post-processing methods for delay embedding and feature scaling of reservoir computers

Reservoir computing is a machine learning method that is well-suited for complex time series prediction tasks. Both delay embedding and the projection of input data into a higher-dimensional space play important roles in enabling accurate predictions. We establish simple post-processing methods that train on past node states at uniformly or randomly-delayed timeshifts. These methods improve reservoir computer prediction performance through increased feature dimension and/or better delay embedding. Here we introduce the multi-random-timeshifting method that randomly recalls previous states of reservoir nodes. The use of multi-random-timeshifting allows for smaller reservoirs while maintaining large feature dimensions, is computationally cheap to optimise, and is our preferred post-processing method. For experimentalists, all our post-processing methods can be translated to readout data sampled from physical reservoirs, which we demonstrate using readout data from an experimentally-realised laser reservoir system.

Authors

Institutions

Publication Details

Journal
Communications Engineering
Published
2025-01-27
DOI
https://doi.org/10.1038/s44172-024-00330-0
Citations
10
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
24.81

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Post-processing methods for delay embedding and feature scaling of reservoir computers

Joshua Robertson, Antonio Hurtado, Kathy Lüdge, Lina Jaurigue et al.
10 citations
Communications Engineering
Neural Networks and Reservoir Computing
24.81
article

Post-processing methods for delay embedding and feature scaling of reservoir computers

Joshua Robertson, Antonio Hurtado, Kathy Lüdge, Lina Jaurigue, Jonnel Anthony Jaurigue
article en
10 citations

Abstract

Reservoir computing is a machine learning method that is well-suited for complex time series prediction tasks. Both delay embedding and the projection of input data into a higher-dimensional space play important roles in enabling accurate predictions. We establish simple post-processing methods that train on past node states at uniformly or randomly-delayed timeshifts. These methods improve reservoir computer prediction performance through increased feature dimension and/or better delay embedding. Here we introduce the multi-random-timeshifting method that randomly recalls previous states of reservoir nodes. The use of multi-random-timeshifting allows for smaller reservoirs while maintaining large feature dimensions, is computationally cheap to optimise, and is our preferred post-processing method. For experimentalists, all our post-processing methods can be translated to readout data sampled from physical reservoirs, which we demonstrate using readout data from an experimentally-realised laser reservoir system.

Communications EngineeringVol. 4(1)
Technische Universität Ilmenau (DE), University of Strathclyde (GB)
Carl-Zeiss-Stiftung, UK Research and Innovation, European Commission, Engineering and Physical Sciences Research Council
Openalex Percentile: Top 1%
Neural Networks and Reservoir Computing
24.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.