A Crisis-Conditioned Reinforcement Learning Framework Demonstrates That Uncertainty-Aware Reward Design Is Necessary, Not Optional, for Global Macroeconomic Policy Optimization
This paper introduces MAKOTO (Multi-domain Adaptive Knowledgefor Open-economy Trend Optimization), a crisis-conditioned deepreinforcement learning framework for global macroeconomic policyoptimization. MAKOTO embeds a continuous IsolationForestuncertainty score calibrated on a pre-crisis reference period(2004-2007) as a multiplicative amplifier within a ProximalPolicy Optimization (PPO) reward function. Applied to a30-country, 24-year World Bank panel (720 observations,2000-2023), MAKOTO achieves a statistically significant 7.1%total reward advantage over an unconditioned baseline (bootstrap95% CI: [+1.947, +4.154]; p < 0.05), robust across threeindependent random seeds, and translating to an estimated $18.8billion in annual welfare gains. An ablation study establishesthat the uncertainty signal is structurally integral to thelearned policy: removing it at evaluation time causesperformance to fall below the unconditioned baseline, confirmingthat crisis-conditioned reward architecture is a necessarydesign principle, not an additive enhancement.
Authors
- Nubaid Khan
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-05-27
- DOI
- https://doi.org/10.5281/zenodo.20417088
- Primary Topic
- Fiscal Policies and Political Economy
- Type
- preprint