Adaptive behaviors emerge from Hebbian-like plasticity through flexible attractors
Adaptive behavior is commonly framed as an optimization problem, in which organisms learn to maximize reward. Here we show that simple networks with local, Hebbian-like learning rules, which have no reward objective, nonetheless reproduce hallmark features of animal reward-seeking when placed in closed-loop environments where rewards arrive as ordinary sensory input. Six canonical local learning rules were tested under these conditions, and despite most rules being designed for unsupervised representation learning, all rules learned to seek out signal. However, at the parameters tested, only one rule, prospective configuration, robustly captured all of a set of tested phenomena: reward-magnitude-dependent learning rates, probability matching, memory retention across contexts, and switching between exploration and exploitation with heavy-tailed statistics. In these networks, actions that produce input become self-sustaining states (attractors) of network dynamics. Attractors reside in an activity-weight space and mediate behaviors, and adapt to their environments rather than being fixed properties of the networks. These flexible geometries provide a parsimonious account of how heavy-tailed runs of repeated choices, which resemble Levy flights seen in foraging, also change with the environment. A single framework then makes predictions about behavior and neural population geometries that can be used to investigate the learning dynamics of the brain.
Authors
- Jonah W. Brenner (ORCID: https://orcid.org/0000-0002-0304-520X)
- Jeffrey C. Erlich (ORCID: https://orcid.org/0000-0001-9073-7986)
- Chunyu A. Duan (ORCID: https://orcid.org/0000-0002-3095-8653)
- Benjamin du Pont (ORCID: https://orcid.org/0009-0006-7469-7754)
- Jason Chen (ORCID: https://orcid.org/0000-0003-3158-9471)
- Chenguang Li (ORCID: https://orcid.org/0000-0003-2884-6414)
- Joanna Aloor (ORCID: https://orcid.org/0000-0003-2125-2840)
- Hanming Ye (ORCID: https://orcid.org/0009-0009-7390-8427)
- Matas Kudarauskas
Institutions
- Brigham and Women's Hospital (US)
- Harvard University (US)
- Sainsbury Laboratory (GB)
- University of Pennsylvania (US)
- Stanford University (US)
Publication Details
- Journal
- bioRxiv (Cold Spring Harbor Laboratory)
- Published
- 2026-11-19
- DOI
- https://doi.org/10.64898/2026.11.18.767638
- Primary Topic
- Neural dynamics and brain function
- Type
- preprint