Dopamine release plateau and outcome signals in dorsal striatum contrast with classic reinforcement learning formulations

We recorded dopamine release signals in centromedial and centrolateral sectors of the striatum as mice learned consecutive versions of visual cue-outcome conditioning tasks. Dopamine release responses differed for the centromedial and centrolateral sites. In neither sector could these be accounted for by classic reinforcement learning alone as classically applied to the activity of nigral dopamine-containing neurons. Medially, cue responses ranged from initial sharp peaks to modulated plateau responses; outcome (reward) responses during cue conditioning were minimal or, initially, negative. At centrolateral sites, by contrast, strong, transient dopamine release responses occurred at both cue and outcome. Prolonged, plateau release responses to cues emerged in both regions when discriminative behavioral responses became required. At most sites, we found no evidence for a transition from outcome signaling to cue signaling, a hallmark of temporal difference reinforcement learning as applied to midbrain dopaminergic neuronal activity. These findings delineate a reshaping of striatal dopamine release activity during learning and suggest that current views of reward prediction error encoding need review to accommodate distinct learning-related spatial and temporal patterns of striatal dopamine release in the dorsal striatum.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2024-10-14
DOI
https://doi.org/10.1038/s41467-024-53176-7
Citations
8
Primary Topic
Transcranial Magnetic Stimulation Studies
Type
article
Field-Weighted Citation Impact
1.98

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dopamine release plateau and outcome signals in dorsal striatum contrast with classic reinforcement learning formulations

A. Matsushima, Emily Hueske, Ara Mahar, Dan Hu et al.
8 citations
Nature Communications
Transcranial Magnetic Stimulation Studies
1.98
article

Dopamine release plateau and outcome signals in dorsal striatum contrast with classic reinforcement learning formulations

A. Matsushima, Emily Hueske, Ara Mahar, Dan Hu, Patlapa Sompolpong, Kathy Tran, Lin Tian, Ann M. Graybiel, Min Jung Kim, Tomoko Yoshida, Daniel J. Gibson, Cynthia J. Schofield
article en
8 citations

Abstract

We recorded dopamine release signals in centromedial and centrolateral sectors of the striatum as mice learned consecutive versions of visual cue-outcome conditioning tasks. Dopamine release responses differed for the centromedial and centrolateral sites. In neither sector could these be accounted for by classic reinforcement learning alone as classically applied to the activity of nigral dopamine-containing neurons. Medially, cue responses ranged from initial sharp peaks to modulated plateau responses; outcome (reward) responses during cue conditioning were minimal or, initially, negative. At centrolateral sites, by contrast, strong, transient dopamine release responses occurred at both cue and outcome. Prolonged, plateau release responses to cues emerged in both regions when discriminative behavioral responses became required. At most sites, we found no evidence for a transition from outcome signaling to cue signaling, a hallmark of temporal difference reinforcement learning as applied to midbrain dopaminergic neuronal activity. These findings delineate a reshaping of striatal dopamine release activity during learning and suggest that current views of reward prediction error encoding need review to accommodate distinct learning-related spatial and temporal patterns of striatal dopamine release in the dorsal striatum.

Nature CommunicationsVol. 15(1)
McGovern Institute for Brain Research (US), Johns Hopkins University (US), Johns Hopkins Medicine (US), Max Planck Florida Institute for Neuroscience (US), Advanced Imaging Research (United States) (US), Massachusetts Institute of Technology (US), Icahn School of Medicine at Mount Sinai (US)
CHDI Foundation, Harvard University, Institute for Quantitative Social Science, Harvard University, National Institutes of Health, National Institute of Mental Health
Zero hunger
Openalex Percentile: Top 13%
Transcranial Magnetic Stimulation Studies
1.98
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.