Optimal Scheduling of a Wind–Solar-Coupled Regional Grid-Side Power System with CAES–BESS Hybrid Energy Storage Based on Reinforcement Learning
Large-scale integration of wind and photovoltaic generation increases uncertainty in regional grid-side power systems and raises new requirements for coordinated hybrid energy storage scheduling. This study develops a reinforcement-learning-based scheduling framework for a wind–solar-coupled regional grid-side power system with compressed air energy storage and battery energy storage (CAES–BESS) hybrid storage. The model represents electricity-side operation, including renewable generation, regional electric load, CAES and BESS operation, grid exchange, and time-of-use electricity pricing. The scheduling task is formulated as a Markov decision process in which the agent observes CAES SOC, BESS SOC, time, renewable output, load, net load, electricity price, and outputs continuous CAES/BESS charging and discharging actions. DSAC is integrated with storage operating constraints and normalized reward terms for grid-interaction cost, grid-power deviation, storage throughput, and reverse power. Its performance is examined using DDPG, PPO, a no-storage reference, and a deterministic optimization benchmark. The cost-smoothing trade-off is assessed using separate engineering metrics.
Authors
- Xinyuan Zhu (ORCID: https://orcid.org/0000-0003-1456-2605)
- Zeyi Sun (ORCID: https://orcid.org/0000-0003-0704-2708)
- Guanghua Zhang (ORCID: https://orcid.org/0000-0002-5605-517X)
- Zhao Zhang
- Xingchen Wu
- Mengxue He
Institutions
- China Power Engineering Consulting Group (China) (CN)
- Xi'an Jiaotong University (CN)
Publication Details
- Journal
- Energies
- Published
- 2026-11-16
- DOI
- https://doi.org/10.3390/en19225529
- Primary Topic
- Electric Power System Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00