HMM-Based Market Regime Detection with RL for Portfolio Management

This paper studies the impact of combining a Hidden Markov Model (HMM) with a Reinforcement Learning (RL) framework, implemented within FinRL, to enhance algorithmic trading. Our objective is to improve trading performance and realism by dynamically adapting to market regimes. Leveraging a portfolio of 30 Dow Jones stocks, we analyze the impact of regime awareness by comparing hybrid RL-HMM agents to standard FinRL algorithms. We observe that RL-HMM outperforms baseline models in Sharpe Ratio, annual returns, and other risk-adjusted performance metrics.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1109/ids66066.2025.00022
Primary Topic
Stock Market Forecasting Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HMM-Based Market Regime Detection with RL for Portfolio Management

Xinda Cheng, Zhen Yin, Jean Ndoutoumou
Stock Market Forecasting Methods
article

HMM-Based Market Regime Detection with RL for Portfolio Management

Xinda Cheng, Zhen Yin, Jean Ndoutoumou
article en

Abstract

This paper studies the impact of combining a Hidden Markov Model (HMM) with a Reinforcement Learning (RL) framework, implemented within FinRL, to enhance algorithmic trading. Our objective is to improve trading performance and realism by dynamically adapting to market regimes. Leveraging a portfolio of 30 Dow Jones stocks, we analyze the impact of regime awareness by comparing hybrid RL-HMM agents to standard FinRL algorithms. We observe that RL-HMM outperforms baseline models in Sharpe Ratio, annual returns, and other risk-adjusted performance metrics.

New York University (US), Columbia University (US)
Openalex Percentile: Top 84%
Stock Market Forecasting Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.