Modular Reinforcement Learning for Multi-Market Portfolio Optimization

Most reinforcement learning (RL) methods for portfolio optimization remain limited to single markets and a single algorithmic paradigm, which restricts their adaptability to regime shifts and heterogeneous conditions. This paper introduces a generalized version of the Modular Portfolio Learning System (MPLS), extending beyond its initial PPO backbone to integrate four RL algorithms: Proximal Policy Optimization (PPO), Deep Q-Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Soft Actor-Critic (SAC). Building on its modular design, MPLS leverages specialized components for sentiment analysis, volatility forecasting, and structural dependency modeling, whose signals are fused within an attention-based decision framework. Unlike prior approaches, MPLS is evaluated independently on three major equity indices (S&P 500, DAX 30, and FTSE 100) across diverse regimes including stable, crisis, recovery, and sideways phases. Experimental results show that MPLS consistently achieved higher Sharpe ratios—typically +40–70% over Minimum Variance Portfolio (MVP) and Risk Parity (RP)—while limiting drawdowns and Conditional Value-at-Risk (CVaR) during stress periods such as the COVID-19 crash. Turnover levels remained moderate, confirming cost-awareness. Ablation and variance analyses highlight the distinct contribution of each module and the robustness of the framework. Overall, MPLS represents a modular, resilient, and practically relevant framework for risk-aware portfolio optimization.