Linking homeostasis to reinforcement learning: internal state control of motivated behavior
For living beings, survival depends on effective regulation of internal physiological states through motivated behaviors. In this perspective, we propose homeostatically regulated reinforcement learning (HRRL) as a framework to describe biological agents that optimize internal states via learned predictive control strategies, integrating biological principles with computational learning. We show that HRRL inherently produces multiple behaviors such as risk aversion, anticipatory regulation, and adaptive movement, aligning with observed biological phenomena. Its extension to deep reinforcement learning enables autonomous exploration, hierarchical behavior, and potential real-world robotic applications. We argue further that HRRL offers a biologically plausible foundation for understanding motivation, learning, and decision-making, with broad implications for artificial intelligence (AI), neuroscience, and understanding the causes of psychiatric disorders, ultimately advancing our understanding of adaptive behavior in complex environments. • The Homeostatically Regulated Reinforcement Learning (HRRL) explains adaptive stability. • In HRRL, reward is defined as drive reduction from homeostatic deviation. • HRRL explains apparent irrationality through properties of the underlying drive. • HRRL offers an embodied framework for AI, mental disorders, and cognitive theory.
Authors
- Henning Sprekeler (ORCID: https://orcid.org/0000-0003-0690-3553)
- Naoto Yoshida (ORCID: https://orcid.org/0000-0002-9813-0668)
- Boris Gutkin (ORCID: https://orcid.org/0000-0001-6409-979X)
Institutions
- Okinawa Institute of Science and Technology Graduate University (JP)
- Inserm (FR)
- Kyoto University (JP)
- Laboratoire de Neurosciences Cognitives (FR)
- Bernstein Center for Computational Neuroscience Berlin (DE)
- Technische Universität Berlin (DE)
Publication Details
- Journal
- Current Opinion in Behavioral Sciences
- Published
- 2025-11-05
- DOI
- https://doi.org/10.1016/j.cobeha.2025.101611
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.00