Secondary Frequency Regulation Strategy for Energy Storage System Based on Expert Knowledge Guided DDPG

Traditional control methods find it difficult to effectively coordinate multiple frequency regulation resources to cope with the stochastic fluctuation problem caused by intermittent energy sources such as wind power and photovoltaic power generation connected to the grid. Therefore, this paper proposes a deep deterministic policy gradient (DDPG) load frequency control algorithm based on expert knowledge guidance. Firstly, a system frequency response model including battery storage is constructed and the output control law of the energy storage system is designed. Then, the definitions of the state set, the action set and the reward function of a DDPG agent are given, the, and the framework of the DDPG algorithm based on expert knowledge guidance is designed. Lastly, the simulation results demonstrate that compared to PI control and conventional DDPG control, the control method suggested in this study has faster convergence, stronger frequency regulation performance, and better SOC maintenance.