Integrating Local Learning into the Two-Stage Markov Task to Separate Model-Based from Model-Free Learning

The two-stage Markov task, widely-used for measuring model-based relative to model-free learning in humans, has faced skepticism regarding its effectiveness.We suggest a modification to better distinguish the two learning approaches.Our revised task incorporates an additional phase for learning local contingencies, mirroring a strategy from machine learning for separating model-free from model-based algorithms.We evaluated the effectiveness of our revised task through simulations, employing model-free and model-based strategies.

Authors

Publication Details

Journal
SIAM Undergraduate Research Online
Published
2025-01-01
DOI
https://doi.org/10.1137/24s1703392
Primary Topic
Bayesian Modeling and Causal Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Local Learning into the Two-Stage Markov Task to Separate Model-Based from Model-Free Learning

Jack Maloney, Jimmy Vineyard, Seungyeon Oh, Peizhe Li
SIAM Undergraduate Research Online
Bayesian Modeling and Causal Inference
article

Integrating Local Learning into the Two-Stage Markov Task to Separate Model-Based from Model-Free Learning

Jack Maloney, Jimmy Vineyard, Seungyeon Oh, Peizhe Li
article en

Abstract

The two-stage Markov task, widely-used for measuring model-based relative to model-free learning in humans, has faced skepticism regarding its effectiveness.We suggest a modification to better distinguish the two learning approaches.Our revised task incorporates an additional phase for learning local contingencies, mirroring a strategy from machine learning for separating model-free from model-based algorithms.We evaluated the effectiveness of our revised task through simulations, employing model-free and model-based strategies.

SIAM Undergraduate Research OnlineVol. 18
Openalex Percentile: Top 91%
Bayesian Modeling and Causal Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.