Operational Simulation and Performance Evaluation of Electricity Energy Markets Using WoLF-PHC Multi-Agent Reinforcement Learning
As the share of wind and photovoltaic generation in power systems increases, renewable generation and storage are increasingly participating in bidding in electricity markets. However, fluctuations in renewable output, uncertain market prices, and intertemporal coupling in storage operation complicate bidding and increase operating risks. This study develops an electricity energy market simulation framework covering medium- and long-term trading and spot-market trading. The Win or Learn Fast policy hill-climbing (WoLF-PHC) algorithm is used to model multi-agent bidding, accounting for contract settlement, deviation assessment, operating characteristics of conventional units, and constraints on the storage state of charge. Joint renewable-storage operation and independent participation are compared in terms of policy convergence, participant operating profit, consumer procurement cost, renewable utilization, and storage operation. The case study supports the effectiveness of the framework and shows that market participants can develop stable bidding policies. Compared with independent participation, joint operation coordinates energy internally between renewable plants and storage facilities, improving system operating performance while reducing consumer procurement costs and promoting renewable utilization.
Authors
- Xue Gong
- Yu Gong (ORCID: https://orcid.org/0000-0002-5411-376X)
- Zhengpai Cui
- Yinchi Shao
- Xiaoxue Liu
- Yang Zhao
Institutions
- State Grid Corporation of China (China) (CN)
Publication Details
- Journal
- Energies
- Published
- 2026-11-20
- DOI
- https://doi.org/10.3390/en19225621
- Primary Topic
- Electric Power System Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00