Peer-to-Peer Energy Trading with Mid-Market Rate among Virtue Power Plants by Multi-Agent Deep Reinforcement Learning
Efficient energy allocation and utilization are critical challenges in the evolving landscape of decentralized power systems integrated with renewable energy sources. Peer-toPeer (P2P) energy trading offers a novel framework for direct energy transactions among prosumers, enhancing system flexibility and market responsiveness. This paper addresses the complex decision-making processes inherent in P2P energy markets by proposing a Multi-Agent Twin Delayed Deep Deterministic Policy Gradient (MATD3) algorithm. The proposed model leverages Virtual Power Plants (VPPs) to aggregate distributed energy resources, enabling autonomous and optimized energy trading within the P2P framework. VPPs act as intermediaries, enhancing market liquidity, optimizing energy distribution, and ensuring supply reliability. The MATD3-based approach effectively manages high-dimensional continuous action spaces and adapts to the dynamic nature of P2P energy trading. Simulation results indicate that the proposed MADRL model reduces overall energy costs and enhances the performance of VPPs in decentralized energy markets. This research contributes to the advancement of intelligent P2P energy trading mechanisms, emphasizing the pivotal role of reinforcement learning in developing sustainable and resilient energy infrastructures
Authors
- Yuyao Yang (ORCID: https://orcid.org/0000-0002-4628-2440)
- Feng Pan (ORCID: https://orcid.org/0000-0002-0814-1364)
- S. B. Liu (ORCID: https://orcid.org/0000-0001-8787-930X)
- Yuping Huang (ORCID: https://orcid.org/0000-0002-8706-0166)
- Tong Ye (ORCID: https://orcid.org/0009-0004-7403-1499)
- Weijia Yang (ORCID: https://orcid.org/0000-0003-1638-0792)
Institutions
- University of Science and Technology of China (CN)
- Chinese Academy of Sciences (CN)
- Guangzhou Institute of Energy Conversion (CN)
- China Southern Power Grid (China) (CN)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/ceect63656.2024.10898991
- Primary Topic
- Smart Grid Energy Management
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- China Southern Power Grid