Trial history and model-derived reward prediction errors in mouse visual decisions

A reward prediction error (RPE) estimated from an animal's behavior can predict its next choice. Part of this predictive value may come from information about earlier trials that a choice model could also use directly. We asked whether a model-derived RPE improves choice prediction beyond the observable history of stimuli, choices, and rewards. We analyzed 275,292 trials from 107 mice performing the International Brain Laboratory visual decision task and evaluated the main choice models on sessions that were not used for fitting. Recent choices strongly improved prediction. An RPE based on a stimulus-dependent reward expectation added a small gain beyond the preceding choice and reward, and this gain fell to near zero once the model included the preceding stimulus. When the model also summarized choices and rewards over several earlier trials, an RPE trace with the same retention parameter as the history traces did not reliably improve prediction. In simulated agents with known decision rules, a simplified version of this comparison detected an RPE-based learning rule in which choices depended on accumulated prediction errors, and did not improve prediction for an agent that used trial history directly. In mice, the state-dependent RPE and its trace added little predictive information beyond observable trial history, which limits what choice prediction alone can reveal about prediction-error learning.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-20
DOI
https://doi.org/10.64898/2026.11.19.767881
Primary Topic
Neural and Behavioral Psychology Studies
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Trial history and model-derived reward prediction errors in mouse visual decisions

Alireza Khanteymoori, Amitis Mirabedini, Raya JanatAbadi
bioRxiv (Cold Spring Harbor Laboratory)
Neural and Behavioral Psychology Studies
preprint

Trial history and model-derived reward prediction errors in mouse visual decisions

Alireza Khanteymoori, Amitis Mirabedini, Raya JanatAbadi
preprint en

Abstract

A reward prediction error (RPE) estimated from an animal's behavior can predict its next choice. Part of this predictive value may come from information about earlier trials that a choice model could also use directly. We asked whether a model-derived RPE improves choice prediction beyond the observable history of stimuli, choices, and rewards. We analyzed 275,292 trials from 107 mice performing the International Brain Laboratory visual decision task and evaluated the main choice models on sessions that were not used for fitting. Recent choices strongly improved prediction. An RPE based on a stimulus-dependent reward expectation added a small gain beyond the preceding choice and reward, and this gain fell to near zero once the model included the preceding stimulus. When the model also summarized choices and rewards over several earlier trials, an RPE trace with the same retention parameter as the history traces did not reliably improve prediction. In simulated agents with known decision rules, a simplified version of this comparison detected an RPE-based learning rule in which choices depended on accumulated prediction errors, and did not improve prediction for an agent that used trial history directly. In mice, the state-dependent RPE and its trace added little predictive information beyond observable trial history, which limits what choice prediction alone can reveal about prediction-error learning.

bioRxiv (Cold Spring Harbor Laboratory)
Sharif University of Technology (IR), University of Freiburg (DE)
Neural and Behavioral Psychology Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon