Microgrid control under uncertainty

Microgrids – decentralized electrical grids that can function both in conjunction with wide area macrogrids and without – are a powerful tool to address energy resiliency and climate change mitigation. Microgrid control, however, remains a challenge; their bespoke nature and the existence of multiple sources of uncertainty lead to a control problem that traditional grid modeling and control techniques are ill-suited to handle. We build a microgrid interface to simulate microgrids under uncertainty and devise off-policy reinforcement learning algorithms to control microgrids. Our algorithms, which incorporate domain randomization and random network distillation for exploration and computational efficiency, achieve performance better than model predictive control and rule based control benchmarks under battery model uncertainty on seven of ten tested scenarios. Our model code is available at https://github.com/ahalev/Microgrid-Control-Under-Uncertainty and our microgrid simulator is available at https://github.com/ahalev/python-microgrid . • Reinforcement learning outperforms traditional algorithms in high-uncertainty scenarios. • An open-source microgrid simulator is built for future research.