Linking homeostasis to reinforcement learning: internal state control of motivated behavior

For living beings, survival depends on effective regulation of internal physiological states through motivated behaviors. In this perspective, we propose homeostatically regulated reinforcement learning (HRRL) as a framework to describe biological agents that optimize internal states via learned predictive control strategies, integrating biological principles with computational learning. We show that HRRL inherently produces multiple behaviors such as risk aversion, anticipatory regulation, and adaptive movement, aligning with observed biological phenomena. Its extension to deep reinforcement learning enables autonomous exploration, hierarchical behavior, and potential real-world robotic applications. We argue further that HRRL offers a biologically plausible foundation for understanding motivation, learning, and decision-making, with broad implications for artificial intelligence (AI), neuroscience, and understanding the causes of psychiatric disorders, ultimately advancing our understanding of adaptive behavior in complex environments. • The Homeostatically Regulated Reinforcement Learning (HRRL) explains adaptive stability. • In HRRL, reward is defined as drive reduction from homeostatic deviation. • HRRL explains apparent irrationality through properties of the underlying drive. • HRRL offers an embodied framework for AI, mental disorders, and cognitive theory.

Authors

Institutions

Publication Details

Journal
Current Opinion in Behavioral Sciences
Published
2025-11-05
DOI
https://doi.org/10.1016/j.cobeha.2025.101611
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Linking homeostasis to reinforcement learning: internal state control of motivated behavior

Henning Sprekeler, Naoto Yoshida, Boris Gutkin
Current Opinion in Behavioral Sciences
Reinforcement Learning in Robotics
article

Linking homeostasis to reinforcement learning: internal state control of motivated behavior

Henning Sprekeler, Naoto Yoshida, Boris Gutkin
article en

Abstract

For living beings, survival depends on effective regulation of internal physiological states through motivated behaviors. In this perspective, we propose homeostatically regulated reinforcement learning (HRRL) as a framework to describe biological agents that optimize internal states via learned predictive control strategies, integrating biological principles with computational learning. We show that HRRL inherently produces multiple behaviors such as risk aversion, anticipatory regulation, and adaptive movement, aligning with observed biological phenomena. Its extension to deep reinforcement learning enables autonomous exploration, hierarchical behavior, and potential real-world robotic applications. We argue further that HRRL offers a biologically plausible foundation for understanding motivation, learning, and decision-making, with broad implications for artificial intelligence (AI), neuroscience, and understanding the causes of psychiatric disorders, ultimately advancing our understanding of adaptive behavior in complex environments. • The Homeostatically Regulated Reinforcement Learning (HRRL) explains adaptive stability. • In HRRL, reward is defined as drive reduction from homeostatic deviation. • HRRL explains apparent irrationality through properties of the underlying drive. • HRRL offers an embodied framework for AI, mental disorders, and cognitive theory.

Current Opinion in Behavioral SciencesVol. 66
Okinawa Institute of Science and Technology Graduate University (JP), Inserm (FR), Kyoto University (JP), Laboratoire de Neurosciences Cognitives (FR), Bernstein Center for Computational Neuroscience Berlin (DE), Technische Universität Berlin (DE)
Openalex Percentile: Top 83%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.