Improved Reinforcement Learning for Multi-Objective Optimization Operation of Cascade Reservoir System Based on Monotonic Property

In this paper, improved reinforcement learning (IRL) is designed for the multi-objective optimization operation of a cascade reservoir system. The primary improvement of IRL is searching within limited solution space, based on the derived monotonic property: the first-order derivative relationship between individual reservoir water release decisions for mainstream use (i.e., hydropower generation) as well as tributary use (i.e., regional water supply) and the cascade system’s or a particular reservoir’s water availability, along with the synchronicity and substitutability assumption of storage distribution in the cascade system. The improved algorithm is then applied to a real-world cascade reservoir system in the Yangtze River of China. The results demonstrate the high computational efficiency and reasonable interpretability of IRL.