Noise-aware training of neuromorphic dynamic device networks
In materio computing offers the potential for widespread embodied intelligence by leveraging the intrinsic dynamics of complex systems for efficient sensing, processing, and interaction. While individual devices offer basic data processing capabilities, networks of interconnected devices can perform more complex and varied tasks. However, designing such networks for dynamic tasks is challenging in the absence of physical models and accurate characterization of device noise. We introduce the Noise-Aware Dynamic Optimization (NADO) framework for training networks of dynamical devices, using Neural Stochastic Differential Equations (Neural-SDEs) as differentiable digital twins to capture both the dynamics and stochasticity of devices with intrinsic memory. Our approach combines backpropagation through time with cascade learning, enabling effective exploitation of the temporal properties of physical devices. We validate this method on networks of spintronic devices across both temporal classification and regression tasks. By decoupling device model training from network connectivity optimization, our framework reduces data requirements and enables robust, gradient-based programming of dynamical devices without requiring analytical descriptions of their behaviour.
Authors
- W. R. Branford (ORCID: https://orcid.org/0000-0002-4821-4097)
- David Ray Griffin (ORCID: https://orcid.org/0009-0002-2759-7073)
- Elisa Donati (ORCID: https://orcid.org/0000-0002-8091-1298)
- Eleni Vasilaki (ORCID: https://orcid.org/0000-0003-3705-7070)
- Thomas J. Hayward
- Susan Stepney (ORCID: https://orcid.org/0000-0003-3146-5401)
- Jack C. Gartside (ORCID: https://orcid.org/0000-0002-7044-7399)
- Matthew O. A. Ellis (ORCID: https://orcid.org/0000-0003-0338-8920)
- Charles Swindells (ORCID: https://orcid.org/0000-0002-9572-5930)
- Ian T. Vidamour (ORCID: https://orcid.org/0000-0002-6909-2711)
- G. Venkat (ORCID: https://orcid.org/0000-0001-6255-3151)
- Kilian D. Stenning (ORCID: https://orcid.org/0000-0003-0955-3640)
- Luca Manneschi (ORCID: https://orcid.org/0000-0002-0125-1325)
- Chin‐Feng Lai (ORCID: https://orcid.org/0000-0001-7138-0272)
- Dana Hariga
- Denis Donskikh
- Daanish Sonawala
Institutions
- SIB Swiss Institute of Bioinformatics (CH)
- Institute for Biomedical Engineering (CH)
- Imperial College London (GB)
- University of York (GB)
- University of Sheffield (GB)
Publication Details
- Journal
- Nature Communications
- Published
- 2025-10-16
- DOI
- https://doi.org/10.1038/s41467-025-64232-1
- Citations
- 1
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- Royal Academy of Engineering
- Imperial College London
- National Natural Science Foundation of China
- Engineering and Physical Sciences Research Council