A Crisis-Conditioned Reinforcement Learning Framework Demonstrates That Uncertainty-Aware Reward Design Is Necessary, Not Optional, for Global Macroeconomic Policy Optimization

This paper introduces MAKOTO (Multi-domain Adaptive Knowledgefor Open-economy Trend Optimization), a crisis-conditioned deepreinforcement learning framework for global macroeconomic policyoptimization. MAKOTO embeds a continuous IsolationForestuncertainty score calibrated on a pre-crisis reference period(2004-2007) as a multiplicative amplifier within a ProximalPolicy Optimization (PPO) reward function. Applied to a30-country, 24-year World Bank panel (720 observations,2000-2023), MAKOTO achieves a statistically significant 7.1%total reward advantage over an unconditioned baseline (bootstrap95% CI: [+1.947, +4.154]; p < 0.05), robust across threeindependent random seeds, and translating to an estimated $18.8billion in annual welfare gains. An ablation study establishesthat the uncertainty signal is structurally integral to thelearned policy: removing it at evaluation time causesperformance to fall below the unconditioned baseline, confirmingthat crisis-conditioned reward architecture is a necessarydesign principle, not an additive enhancement.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-27
DOI
https://doi.org/10.5281/zenodo.20417088
Primary Topic
Fiscal Policies and Political Economy
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

A Crisis-Conditioned Reinforcement Learning Framework Demonstrates That Uncertainty-Aware Reward Design Is Necessary, Not Optional, for Global Macroeconomic Policy Optimization

Nubaid Khan
Zenodo (CERN European Organization for Nuclear Research)
Fiscal Policies and Political Economy
preprint

A Crisis-Conditioned Reinforcement Learning Framework Demonstrates That Uncertainty-Aware Reward Design Is Necessary, Not Optional, for Global Macroeconomic Policy Optimization

Nubaid Khan
preprint en

Abstract

This paper introduces MAKOTO (Multi-domain Adaptive Knowledgefor Open-economy Trend Optimization), a crisis-conditioned deepreinforcement learning framework for global macroeconomic policyoptimization. MAKOTO embeds a continuous IsolationForestuncertainty score calibrated on a pre-crisis reference period(2004-2007) as a multiplicative amplifier within a ProximalPolicy Optimization (PPO) reward function. Applied to a30-country, 24-year World Bank panel (720 observations,2000-2023), MAKOTO achieves a statistically significant 7.1%total reward advantage over an unconditioned baseline (bootstrap95% CI: [+1.947, +4.154]; p < 0.05), robust across threeindependent random seeds, and translating to an estimated $18.8billion in annual welfare gains. An ablation study establishesthat the uncertainty signal is structurally integral to thelearned policy: removing it at evaluation time causesperformance to fall below the unconditioned baseline, confirmingthat crisis-conditioned reward architecture is a necessarydesign principle, not an additive enhancement.

Zenodo (CERN European Organization for Nuclear Research)
Fiscal Policies and Political Economy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.