Dopamine release plateau and outcome signals in dorsal striatum contrast with classic reinforcement learning formulations
We recorded dopamine release signals in centromedial and centrolateral sectors of the striatum as mice learned consecutive versions of visual cue-outcome conditioning tasks. Dopamine release responses differed for the centromedial and centrolateral sites. In neither sector could these be accounted for by classic reinforcement learning alone as classically applied to the activity of nigral dopamine-containing neurons. Medially, cue responses ranged from initial sharp peaks to modulated plateau responses; outcome (reward) responses during cue conditioning were minimal or, initially, negative. At centrolateral sites, by contrast, strong, transient dopamine release responses occurred at both cue and outcome. Prolonged, plateau release responses to cues emerged in both regions when discriminative behavioral responses became required. At most sites, we found no evidence for a transition from outcome signaling to cue signaling, a hallmark of temporal difference reinforcement learning as applied to midbrain dopaminergic neuronal activity. These findings delineate a reshaping of striatal dopamine release activity during learning and suggest that current views of reward prediction error encoding need review to accommodate distinct learning-related spatial and temporal patterns of striatal dopamine release in the dorsal striatum.
Authors
- A. Matsushima (ORCID: https://orcid.org/0000-0002-1313-9285)
- Emily Hueske (ORCID: https://orcid.org/0009-0009-6861-5961)
- Ara Mahar (ORCID: https://orcid.org/0000-0002-4922-5572)
- Dan Hu (ORCID: https://orcid.org/0000-0002-0994-8434)
- Patlapa Sompolpong (ORCID: https://orcid.org/0009-0009-9054-4303)
- Kathy Tran (ORCID: https://orcid.org/0009-0001-3515-3432)
- Lin Tian (ORCID: https://orcid.org/0000-0001-7012-6926)
- Ann M. Graybiel (ORCID: https://orcid.org/0000-0002-4326-7720)
- Min Jung Kim (ORCID: https://orcid.org/0000-0002-4748-0895)
- Tomoko Yoshida (ORCID: https://orcid.org/0000-0003-3961-0095)
- Daniel J. Gibson (ORCID: https://orcid.org/0000-0003-4376-6041)
- Cynthia J. Schofield (ORCID: https://orcid.org/0000-0002-3871-7686)
Institutions
- McGovern Institute for Brain Research (US)
- Johns Hopkins University (US)
- Johns Hopkins Medicine (US)
- Max Planck Florida Institute for Neuroscience (US)
- Advanced Imaging Research (United States) (US)
- Massachusetts Institute of Technology (US)
- Icahn School of Medicine at Mount Sinai (US)
Publication Details
- Journal
- Nature Communications
- Published
- 2024-10-14
- DOI
- https://doi.org/10.1038/s41467-024-53176-7
- Citations
- 8
- Primary Topic
- Transcranial Magnetic Stimulation Studies
- Type
- article
- Field-Weighted Citation Impact
- 1.98
Funders
- CHDI Foundation
- Harvard University
- Institute for Quantitative Social Science, Harvard University
- National Institutes of Health
- National Institute of Mental Health