Operational Simulation and Performance Evaluation of Electricity Energy Markets Using WoLF-PHC Multi-Agent Reinforcement Learning

As the share of wind and photovoltaic generation in power systems increases, renewable generation and storage are increasingly participating in bidding in electricity markets. However, fluctuations in renewable output, uncertain market prices, and intertemporal coupling in storage operation complicate bidding and increase operating risks. This study develops an electricity energy market simulation framework covering medium- and long-term trading and spot-market trading. The Win or Learn Fast policy hill-climbing (WoLF-PHC) algorithm is used to model multi-agent bidding, accounting for contract settlement, deviation assessment, operating characteristics of conventional units, and constraints on the storage state of charge. Joint renewable-storage operation and independent participation are compared in terms of policy convergence, participant operating profit, consumer procurement cost, renewable utilization, and storage operation. The case study supports the effectiveness of the framework and shows that market participants can develop stable bidding policies. Compared with independent participation, joint operation coordinates energy internally between renewable plants and storage facilities, improving system operating performance while reducing consumer procurement costs and promoting renewable utilization.

Authors

Institutions

Publication Details

Journal
Energies
Published
2026-11-20
DOI
https://doi.org/10.3390/en19225621
Primary Topic
Electric Power System Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Operational Simulation and Performance Evaluation of Electricity Energy Markets Using WoLF-PHC Multi-Agent Reinforcement Learning

Xue Gong, Yu Gong, Zhengpai Cui, Yinchi Shao et al.
2 links
Energies
Electric Power System Optimization
article

Operational Simulation and Performance Evaluation of Electricity Energy Markets Using WoLF-PHC Multi-Agent Reinforcement Learning

Xue Gong, Yu Gong, Zhengpai Cui, Yinchi Shao, Xiaoxue Liu, Yang Zhao
article en

Abstract

As the share of wind and photovoltaic generation in power systems increases, renewable generation and storage are increasingly participating in bidding in electricity markets. However, fluctuations in renewable output, uncertain market prices, and intertemporal coupling in storage operation complicate bidding and increase operating risks. This study develops an electricity energy market simulation framework covering medium- and long-term trading and spot-market trading. The Win or Learn Fast policy hill-climbing (WoLF-PHC) algorithm is used to model multi-agent bidding, accounting for contract settlement, deviation assessment, operating characteristics of conventional units, and constraints on the storage state of charge. Joint renewable-storage operation and independent participation are compared in terms of policy convergence, participant operating profit, consumer procurement cost, renewable utilization, and storage operation. The case study supports the effectiveness of the framework and shows that market participants can develop stable bidding policies. Compared with independent participation, joint operation coordinates energy internally between renewable plants and storage facilities, improving system operating performance while reducing consumer procurement costs and promoting renewable utilization.

EnergiesVol. 19(22)
State Grid Corporation of China (China) (CN)
Affordable and clean energy, Climate action
Electric Power System Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Operational Simulation and Performance Evaluation of Electricity Energy Markets Using WoLF-PHC Multi-Agent Reinforcement Learning — Xue Gong, Yu Gong, et al. · Energies (2026) | TGRS Research Map | TGRS