Active inference with reusable state-dependent value profiles

Abstract Optimal behavior in volatile environments requires agents to deploy different value-control regimes across hidden latent structures. However, representing independent preferences, biases, and action confidence for every situation is computationally and statistically intractable. We introduce value profiles: a compact set of reusable parameter bundles—comprising outcome preferences, policy priors, and action precision—assigned to hidden states in a generative model. As posterior beliefs evolve trial-by-trial, effective control parameters emerge through belief-weighted mixing. This enables state-conditional strategy recruitment without the need for independent parameterization of every context. We evaluate this framework in a probabilistic reversal learning setting using simulation-based model recovery and parameter recovery, comparing profile-based models against static and uncertainty-coupled precision baselines. Model comparison favors the profile-based architecture, with consistent parameter recovery demonstrating its structural identifiability. Beyond predictive fit, we show how the framework allows for a mechanistic attribution of behavior to specific adaptive channels, distinguishing between changes in what an agent prefers and how decisively it acts. Overall, reusable value profiles provide a tractable computational account of belief-conditioned control, offering a mode-like representational scheme for behavioral flexibility that is both identifiable and theoretically grounded.

Authors

Publication Details

Journal
Biological Cybernetics
Published
2026-10-09
DOI
https://doi.org/10.1007/s00422-026-01066-0
Primary Topic
Embodied and Extended Cognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Active inference with reusable state-dependent value profiles

Jacob Poschl
Biological Cybernetics
Embodied and Extended Cognition
article

Active inference with reusable state-dependent value profiles

Jacob Poschl
article en

Abstract

Abstract Optimal behavior in volatile environments requires agents to deploy different value-control regimes across hidden latent structures. However, representing independent preferences, biases, and action confidence for every situation is computationally and statistically intractable. We introduce value profiles: a compact set of reusable parameter bundles—comprising outcome preferences, policy priors, and action precision—assigned to hidden states in a generative model. As posterior beliefs evolve trial-by-trial, effective control parameters emerge through belief-weighted mixing. This enables state-conditional strategy recruitment without the need for independent parameterization of every context. We evaluate this framework in a probabilistic reversal learning setting using simulation-based model recovery and parameter recovery, comparing profile-based models against static and uncertainty-coupled precision baselines. Model comparison favors the profile-based architecture, with consistent parameter recovery demonstrating its structural identifiability. Beyond predictive fit, we show how the framework allows for a mechanistic attribution of behavior to specific adaptive channels, distinguishing between changes in what an agent prefers and how decisively it acts. Overall, reusable value profiles provide a tractable computational account of belief-conditioned control, offering a mode-like representational scheme for behavioral flexibility that is both identifiable and theoretically grounded.

Biological CyberneticsVol. 120(5-6)
Openalex Percentile: Top 98%
Embodied and Extended Cognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Active inference with reusable state-dependent value profiles — Jacob Poschl · Biological Cybernetics (2026) | TGRS Research Map | TGRS