Optimal Scheduling of a Wind–Solar-Coupled Regional Grid-Side Power System with CAES–BESS Hybrid Energy Storage Based on Reinforcement Learning

Large-scale integration of wind and photovoltaic generation increases uncertainty in regional grid-side power systems and raises new requirements for coordinated hybrid energy storage scheduling. This study develops a reinforcement-learning-based scheduling framework for a wind–solar-coupled regional grid-side power system with compressed air energy storage and battery energy storage (CAES–BESS) hybrid storage. The model represents electricity-side operation, including renewable generation, regional electric load, CAES and BESS operation, grid exchange, and time-of-use electricity pricing. The scheduling task is formulated as a Markov decision process in which the agent observes CAES SOC, BESS SOC, time, renewable output, load, net load, electricity price, and outputs continuous CAES/BESS charging and discharging actions. DSAC is integrated with storage operating constraints and normalized reward terms for grid-interaction cost, grid-power deviation, storage throughput, and reverse power. Its performance is examined using DDPG, PPO, a no-storage reference, and a deterministic optimization benchmark. The cost-smoothing trade-off is assessed using separate engineering metrics.

Authors

Institutions

Publication Details

Journal
Energies
Published
2026-11-16
DOI
https://doi.org/10.3390/en19225529
Primary Topic
Electric Power System Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Optimal Scheduling of a Wind–Solar-Coupled Regional Grid-Side Power System with CAES–BESS Hybrid Energy Storage Based on Reinforcement Learning

Xinyuan Zhu, Zeyi Sun, Guanghua Zhang, Zhao Zhang et al.
Energies
Electric Power System Optimization
article

Optimal Scheduling of a Wind–Solar-Coupled Regional Grid-Side Power System with CAES–BESS Hybrid Energy Storage Based on Reinforcement Learning

Xinyuan Zhu, Zeyi Sun, Guanghua Zhang, Zhao Zhang, Xingchen Wu, Mengxue He
article en

Abstract

Large-scale integration of wind and photovoltaic generation increases uncertainty in regional grid-side power systems and raises new requirements for coordinated hybrid energy storage scheduling. This study develops a reinforcement-learning-based scheduling framework for a wind–solar-coupled regional grid-side power system with compressed air energy storage and battery energy storage (CAES–BESS) hybrid storage. The model represents electricity-side operation, including renewable generation, regional electric load, CAES and BESS operation, grid exchange, and time-of-use electricity pricing. The scheduling task is formulated as a Markov decision process in which the agent observes CAES SOC, BESS SOC, time, renewable output, load, net load, electricity price, and outputs continuous CAES/BESS charging and discharging actions. DSAC is integrated with storage operating constraints and normalized reward terms for grid-interaction cost, grid-power deviation, storage throughput, and reverse power. Its performance is examined using DDPG, PPO, a no-storage reference, and a deterministic optimization benchmark. The cost-smoothing trade-off is assessed using separate engineering metrics.

EnergiesVol. 19(22)
China Power Engineering Consulting Group (China) (CN), Xi'an Jiaotong University (CN)
Electric Power System Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon