Regime-Aware Portfolio Rebalancing Using Hidden Markov Models and Reinforcement Learning

Portfolio rebalancing in multi-asset funds is typically governed by fixed calendar rules or threshold triggers, ignoring the information content of prevailing market conditions. This paper proposes a framework that combines Hidden Markov Models (HMMs) and Q-learning to learn regime-aware rebalancing policies for a benchmark-relative balanced portfolio. A Gaussian HMM is fitted on seven macro-financial features to produce interpretable and discrete market regime labels, which form the core of a structured 30-state Markov Decision Process encoding the current regime, existing portfolio allocation, and regime duration. Then, a Q-learning agent is trained to learn the best strategy (whether to rebalance or not) based on the market regime. This agent is benchmarked against a static 50/50 portfolio, a framing that reflects real-world private banking and wealth management practice. The agent delivers higher returns than the passive benchmark with positive information ratios in both in-sample and out-of-sample periods, executing a small number of rebalances. Unlike deep reinforcement learning approaches, Q-learning provides a fully inspectable and auditable policy. This is a critical requirement in private banking, where investment decisions must be explainable to clients and regulators. Comparison against a deterministic rule-based regime strategy confirms that the Q-learning component adds measurable value beyond the regime signal alone. We conclude that the proposed architecture offers a practical path toward systematic, low-turnover, and interpretable portfolio management, with clear potential for extension to richer state spaces and asset universes.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-11-17
DOI
https://doi.org/10.3390/make8110386
Primary Topic
Stock Market Forecasting Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Regime-Aware Portfolio Rebalancing Using Hidden Markov Models and Reinforcement Learning

Manuel A. Sánchez-Montañés, Íñigo Gómez-Carvajal, Ignacio Megías-Comín
3 links
Machine Learning and Knowledge Extraction
Stock Market Forecasting Methods
article

Regime-Aware Portfolio Rebalancing Using Hidden Markov Models and Reinforcement Learning

Manuel A. Sánchez-Montañés, Íñigo Gómez-Carvajal, Ignacio Megías-Comín
article en

Abstract

Portfolio rebalancing in multi-asset funds is typically governed by fixed calendar rules or threshold triggers, ignoring the information content of prevailing market conditions. This paper proposes a framework that combines Hidden Markov Models (HMMs) and Q-learning to learn regime-aware rebalancing policies for a benchmark-relative balanced portfolio. A Gaussian HMM is fitted on seven macro-financial features to produce interpretable and discrete market regime labels, which form the core of a structured 30-state Markov Decision Process encoding the current regime, existing portfolio allocation, and regime duration. Then, a Q-learning agent is trained to learn the best strategy (whether to rebalance or not) based on the market regime. This agent is benchmarked against a static 50/50 portfolio, a framing that reflects real-world private banking and wealth management practice. The agent delivers higher returns than the passive benchmark with positive information ratios in both in-sample and out-of-sample periods, executing a small number of rebalances. Unlike deep reinforcement learning approaches, Q-learning provides a fully inspectable and auditable policy. This is a critical requirement in private banking, where investment decisions must be explainable to clients and regulators. Comparison against a deterministic rule-based regime strategy confirms that the Q-learning component adds measurable value beyond the regime signal alone. We conclude that the proposed architecture offers a practical path toward systematic, low-turnover, and interpretable portfolio management, with clear potential for extension to richer state spaces and asset universes.

Machine Learning and Knowledge ExtractionVol. 8(11)
Universidad Autónoma de Madrid (ES)
Stock Market Forecasting Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon