A Bi-Level MIQP + SAC Framework for Short-Term Optimal Scheduling of a Hydro–PV–Battery Energy Storage System

With the increasing integration of photovoltaic (PV) generation, short-term scheduling of hydro–PV–battery energy storage systems (HPBS) faces growing challenges due to the stochastic variability of PV output, the temporal coupling of hydropower operation, and the accumulation of deviations during the real-time execution of day-ahead schedules. This paper proposes a bi-level coordinated scheduling framework that integrates day-ahead mixed-integer quadratic programming (MIQP) with intraday Soft Actor–Critic (SAC)-based correction. In the upper layer, MIQP generates a 24 h baseline schedule subject to unit output limits, mutually exclusive charging/discharging logic, and operational constraints. In the lower layer, SAC performs bounded real-time residual correction for hydropower and battery storage around the MIQP baseline, while a deviation-triggered replanning mechanism forms a closed-loop process of planning, execution, correction, and replanning. Comparative experiments under the tested setting show that SAC achieves better overall performance than Deep Deterministic Policy Gradient (DDPG), Twin Delayed Deep Deterministic Policy Gradient (TD3), and Proximal Policy Optimization (PPO). Typical-day evaluations under dry-, normal-, and wet-season conditions show that, in the selected case studies, the proposed MIQP + SAC framework achieves better performance than standalone MIQP and MIQP-Replan, which refers to a deviation-triggered MIQP re-optimization strategy, in load tracking, PV curtailment reduction, and hydro-storage coordination. These results indicate the effectiveness of the proposed framework for short-term HPBS scheduling under representative operating conditions.