Bayesian Modeling of Context-Specific Goal-Directed and Habitual Control in Sequential Decision Making

It is an open question how context-specific habits develop alongside goal-directed planning. We examined action sequence repetition, contingency change, and context switching using a three-step optimization task with interleaved planning and habit contexts. During an initial acquisition phase, optimal sequences varied in the planning context but remained constant in the habit context. When contingencies changed, the original habit sequence became suboptimal and another became optimal. Action sequence repetition improved response speed and optimal-choice performance in the habit context relative to the planning context. Following the contingency change, both advantages initially reversed. Optimal-choice performance in the habit context subsequently recovered but did not significantly exceed that in the planning context, while responses remained slower in the habit context. Context switches reduced optimal-choice performance in both directions, with additional slowing when switching from habit to planning. The Bayesian contextual control model captured choice patterns through learned action sequence priors, goal-directed evaluation, and context inference. Allowing a context-stability bias to vary across participants did not improve model performance. These findings suggest that sequence repetition facilitates performance under stable contingencies while impairing adaptation to change.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-09
DOI
https://doi.org/10.64898/2026.11.06.764848
Primary Topic
Neural and Behavioral Psychology Studies
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Bayesian Modeling of Context-Specific Goal-Directed and Habitual Control in Sequential Decision Making

Willi Hieke, Michael N. Smolka, Sia Hranova, Arvid Pietsch et al.
bioRxiv (Cold Spring Harbor Laboratory)
Neural and Behavioral Psychology Studies
preprint

Bayesian Modeling of Context-Specific Goal-Directed and Habitual Control in Sequential Decision Making

Willi Hieke, Michael N. Smolka, Sia Hranova, Arvid Pietsch, Stefan J Kiebel, Sarah Schwoebel
preprint en

Abstract

It is an open question how context-specific habits develop alongside goal-directed planning. We examined action sequence repetition, contingency change, and context switching using a three-step optimization task with interleaved planning and habit contexts. During an initial acquisition phase, optimal sequences varied in the planning context but remained constant in the habit context. When contingencies changed, the original habit sequence became suboptimal and another became optimal. Action sequence repetition improved response speed and optimal-choice performance in the habit context relative to the planning context. Following the contingency change, both advantages initially reversed. Optimal-choice performance in the habit context subsequently recovered but did not significantly exceed that in the planning context, while responses remained slower in the habit context. Context switches reduced optimal-choice performance in both directions, with additional slowing when switching from habit to planning. The Bayesian contextual control model captured choice patterns through learned action sequence priors, goal-directed evaluation, and context inference. Allowing a context-stability bias to vary across participants did not improve model performance. These findings suggest that sequence repetition facilitates performance under stable contingencies while impairing adaptation to change.

bioRxiv (Cold Spring Harbor Laboratory)
Technische Universität Dresden (DE)
Neural and Behavioral Psychology Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon