Post-processing methods for delay embedding and feature scaling of reservoir computers
Reservoir computing is a machine learning method that is well-suited for complex time series prediction tasks. Both delay embedding and the projection of input data into a higher-dimensional space play important roles in enabling accurate predictions. We establish simple post-processing methods that train on past node states at uniformly or randomly-delayed timeshifts. These methods improve reservoir computer prediction performance through increased feature dimension and/or better delay embedding. Here we introduce the multi-random-timeshifting method that randomly recalls previous states of reservoir nodes. The use of multi-random-timeshifting allows for smaller reservoirs while maintaining large feature dimensions, is computationally cheap to optimise, and is our preferred post-processing method. For experimentalists, all our post-processing methods can be translated to readout data sampled from physical reservoirs, which we demonstrate using readout data from an experimentally-realised laser reservoir system.
Authors
- Joshua Robertson (ORCID: https://orcid.org/0000-0001-6316-5265)
- Antonio Hurtado (ORCID: https://orcid.org/0000-0002-4448-9034)
- Kathy Lüdge (ORCID: https://orcid.org/0000-0002-4831-8910)
- Lina Jaurigue (ORCID: https://orcid.org/0000-0002-5104-7111)
- Jonnel Anthony Jaurigue
Institutions
- Technische Universität Ilmenau (DE)
- University of Strathclyde (GB)
Publication Details
- Journal
- Communications Engineering
- Published
- 2025-01-27
- DOI
- https://doi.org/10.1038/s44172-024-00330-0
- Citations
- 10
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 24.81
Funders
- Carl-Zeiss-Stiftung
- UK Research and Innovation
- European Commission
- Engineering and Physical Sciences Research Council