A network of Bayesian agents for reward prediction and noise tolerance
The development of computational models capable of performing biologically relevant tasks is essential for real-world applications. This work introduces a network of single neurons modeled as independent agents, each optimizing its own cost function. This optimization governs the firing probability, resulting in spike generation-the core unit of neural communication. The network is hierarchically structured to reflect the connectivity of the dopaminergic reward system. Neurons adapt their synaptic weights to improve input prediction, leading to the self-organization of circuit activity. While the network performs well on classical reward-based tasks, its performance degrades when noise is introduced at the level of individual neurons, affecting spike generation. In line with biological systems, spike generation is inherently noisy, yet the brain achieves reliable computation through evolved mechanisms. Similarly, increasing the network size restores performance. By incorporating strategies to counteract intrinsic noise, this model lays the foundation for robust, energy-efficient, scalable, and noise-tolerant neuromorphic architectures.
Authors
- Jonathan Mapelli (ORCID: https://orcid.org/0000-0002-0381-1576)
- Francesco Maria Puglisi (ORCID: https://orcid.org/0000-0001-6178-2614)
- Giuseppe Pagnoni (ORCID: https://orcid.org/0000-0002-8272-8091)
- Lorenzo Benatti (ORCID: https://orcid.org/0000-0003-4182-7621)
- Daniela Gandolfi (ORCID: https://orcid.org/0000-0003-2315-2309)
- Giovanni Pezzulo (ORCID: https://orcid.org/0000-0001-6813-8282)
- Giulia Maria Boiani
- Tommaso Zanotti (ORCID: https://orcid.org/0000-0002-4145-8830)
- Mirco Tincani
Institutions
- University of Modena and Reggio Emilia (IT)
- SIB Swiss Institute of Bioinformatics (CH)
- University of Zurich (CH)
- ETH Zurich (CH)
- Institute for Biomedical Research and Innovation (IT)
- National Research Council (IT)
- Ferrari (Italy) (IT)
- Institute of Cognitive Sciences and Technologies (IT)
Publication Details
- Journal
- iScience
- Published
- 2025-10-22
- DOI
- https://doi.org/10.1016/j.isci.2025.113813
- Primary Topic
- Time Series Analysis and Forecasting
- Type
- article
- Field-Weighted Citation Impact
- 0.00