A network of Bayesian agents for reward prediction and noise tolerance

The development of computational models capable of performing biologically relevant tasks is essential for real-world applications. This work introduces a network of single neurons modeled as independent agents, each optimizing its own cost function. This optimization governs the firing probability, resulting in spike generation-the core unit of neural communication. The network is hierarchically structured to reflect the connectivity of the dopaminergic reward system. Neurons adapt their synaptic weights to improve input prediction, leading to the self-organization of circuit activity. While the network performs well on classical reward-based tasks, its performance degrades when noise is introduced at the level of individual neurons, affecting spike generation. In line with biological systems, spike generation is inherently noisy, yet the brain achieves reliable computation through evolved mechanisms. Similarly, increasing the network size restores performance. By incorporating strategies to counteract intrinsic noise, this model lays the foundation for robust, energy-efficient, scalable, and noise-tolerant neuromorphic architectures.

Authors

Institutions

Publication Details

Journal
iScience
Published
2025-10-22
DOI
https://doi.org/10.1016/j.isci.2025.113813
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A network of Bayesian agents for reward prediction and noise tolerance

Jonathan Mapelli, Francesco Maria Puglisi, Giuseppe Pagnoni, Lorenzo Benatti et al.
iScience
Time Series Analysis and Forecasting
article

A network of Bayesian agents for reward prediction and noise tolerance

Jonathan Mapelli, Francesco Maria Puglisi, Giuseppe Pagnoni, Lorenzo Benatti, Daniela Gandolfi, Giovanni Pezzulo, Giulia Maria Boiani, Tommaso Zanotti, Mirco Tincani
article en

Abstract

The development of computational models capable of performing biologically relevant tasks is essential for real-world applications. This work introduces a network of single neurons modeled as independent agents, each optimizing its own cost function. This optimization governs the firing probability, resulting in spike generation-the core unit of neural communication. The network is hierarchically structured to reflect the connectivity of the dopaminergic reward system. Neurons adapt their synaptic weights to improve input prediction, leading to the self-organization of circuit activity. While the network performs well on classical reward-based tasks, its performance degrades when noise is introduced at the level of individual neurons, affecting spike generation. In line with biological systems, spike generation is inherently noisy, yet the brain achieves reliable computation through evolved mechanisms. Similarly, increasing the network size restores performance. By incorporating strategies to counteract intrinsic noise, this model lays the foundation for robust, energy-efficient, scalable, and noise-tolerant neuromorphic architectures.

iScienceVol. 28(11)
University of Modena and Reggio Emilia (IT), SIB Swiss Institute of Bioinformatics (CH), University of Zurich (CH), ETH Zurich (CH), Institute for Biomedical Research and Innovation (IT), National Research Council (IT), Ferrari (Italy) (IT), Institute of Cognitive Sciences and Technologies (IT)
Openalex Percentile: Top 63%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.