Regime-Aware Portfolio Rebalancing Using Hidden Markov Models and Reinforcement Learning
Portfolio rebalancing in multi-asset funds is typically governed by fixed calendar rules or threshold triggers, ignoring the information content of prevailing market conditions. This paper proposes a framework that combines Hidden Markov Models (HMMs) and Q-learning to learn regime-aware rebalancing policies for a benchmark-relative balanced portfolio. A Gaussian HMM is fitted on seven macro-financial features to produce interpretable and discrete market regime labels, which form the core of a structured 30-state Markov Decision Process encoding the current regime, existing portfolio allocation, and regime duration. Then, a Q-learning agent is trained to learn the best strategy (whether to rebalance or not) based on the market regime. This agent is benchmarked against a static 50/50 portfolio, a framing that reflects real-world private banking and wealth management practice. The agent delivers higher returns than the passive benchmark with positive information ratios in both in-sample and out-of-sample periods, executing a small number of rebalances. Unlike deep reinforcement learning approaches, Q-learning provides a fully inspectable and auditable policy. This is a critical requirement in private banking, where investment decisions must be explainable to clients and regulators. Comparison against a deterministic rule-based regime strategy confirms that the Q-learning component adds measurable value beyond the regime signal alone. We conclude that the proposed architecture offers a practical path toward systematic, low-turnover, and interpretable portfolio management, with clear potential for extension to richer state spaces and asset universes.
Authors
- Manuel A. Sánchez-Montañés (ORCID: https://orcid.org/0000-0002-5944-0532)
- Íñigo Gómez-Carvajal
- Ignacio Megías-Comín
Institutions
- Universidad Autónoma de Madrid (ES)
Publication Details
- Journal
- Machine Learning and Knowledge Extraction
- Published
- 2026-11-17
- DOI
- https://doi.org/10.3390/make8110386
- Primary Topic
- Stock Market Forecasting Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00