Distributed representations enable robust multi-timescale symbolic computation in neuromorphic hardware
Abstract Programming recurrent spiking neural networks (RSNNs) to robustly perform multi-timescale computation remains a difficult challenge. To address this, we describe a single-shot weight learning scheme to embed robust multi-timescale dynamics into attractor-based RSNNs, by exploiting the properties of high-dimensional distributed representations. We embed finite state machines into the RSNN dynamics by superimposing a symmetric autoassociative weight matrix and asymmetric transition terms, which are each formed by the vector binding of an input and heteroassociative outer-products between states. Our approach is validated through simulations with highly nonideal weights; an experimental closed-loop memristive hardware setup; and on Loihi 2, where it scales seamlessly to large state machines. This work introduces a scalable approach to embed robust symbolic computation through recurrent dynamics into neuromorphic hardware, without requiring parameter fine-tuning or significant platform-specific optimisation. Moreover, it demonstrates that distributed symbolic representations serve as a highly capable representation-invariant language for cognitive algorithms in neuromorphic hardware.
Authors
- Elisabetta Chicca (ORCID: https://orcid.org/0000-0002-5518-8990)
- Alpha Renner (ORCID: https://orcid.org/0000-0002-0724-4169)
- Huaqiang Wu (ORCID: https://orcid.org/0000-0001-8359-7997)
- Madison Cotteret (ORCID: https://orcid.org/0000-0002-4891-4835)
- Hugh Greatorex (ORCID: https://orcid.org/0000-0002-3716-3992)
- Giacomo Indiveri (ORCID: https://orcid.org/0000-0002-7109-1689)
- Emre Neftci (ORCID: https://orcid.org/0000-0002-0332-3273)
- Junren Chen (ORCID: https://orcid.org/0000-0003-3606-9598)
- Martin Ziegler (ORCID: https://orcid.org/0000-0002-6891-5747)
Institutions
- Technische Universität Ilmenau (DE)
- SIB Swiss Institute of Bioinformatics (CH)
- University of Groningen (NL)
- Forschungszentrum Jülich (DE)
- University of Zurich (CH)
- Hochschule für Angewandte Wissenschaften Kiel (DE)
- ETH Zurich (CH)
- Tsinghua University (CN)
Publication Details
- Journal
- Neuromorphic Computing and Engineering
- Published
- 2025-01-09
- DOI
- https://doi.org/10.1088/2634-4386/ada851
- Citations
- 4
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 2.92
Funders
- Deutsche Forschungsgemeinschaft
- Rijksuniversiteit Groningen