Multi-Agent Deep reinforcement learning for EV aggregator bidding in Renewable-Dominated electricity markets

• A unified multi-agent market model simulates strategic interactions under high renewable penetration. • The framework combines fleet scheduling and bidding via MADDPG with Prioritized Experience Replay. • Adaptive bidding strategies are learned in continuous action spaces. • The simulation on a 30-bus system proves improved efficiency and reliability versus baselines. The increasing penetration of renewable energy into electricity markets has introduced significant volatility and uncertainty, presenting new challenges for flexible demand-side resources such as Electric Vehicle Aggregators (EVAs). However, existing approaches to EVA bidding strategies often relied on static pricing forecasts or single-agent optimization frameworks, which failed to capture the dynamic, multi-agent nature of modern electricity markets. To address these limitations, this paper proposes an intelligent bidding strategy framework based on Multi-Agent Deep Reinforcement Learning tailored for heavy-duty EV fleets engaged in freight operations. A multi-agent game-theoretic market model is constructed, incorporating renewable generators, traditional suppliers, industrial and commercial users, and EVAs to replicate real-time interactions within spot markets. A joint optimization strategy is developed to align vehicle scheduling constraints with market participation, while the Multi-agent Deep Deterministic Policy Gradient algorithm is employed to enable adaptive, decentralized learning of optimal bidding behaviors. Simulation results demonstrate that the proposed framework effectively reduces peak loads, smooths load profiles, and enhances EVA revenues under volatile market conditions. The findings offer actionable insights into integrating flexible electric mobility into future renewable-dominated power systems.

Authors

Publication Details

Journal
International Journal of Electrical Power & Energy Systems
Published
2025-12-12
DOI
https://doi.org/10.1016/j.ijepes.2025.111444
Primary Topic
Electric Vehicles and Infrastructure
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Agent Deep reinforcement learning for EV aggregator bidding in Renewable-Dominated electricity markets

Yuanshi Zhang, Haizhou Liu, Amin Mohammadpour Shotorbani, Antônio Carlos Zambroni de Souza et al.
International Journal of Electrical Power & Energy Systems
Electric Vehicles and Infrastructure
article

Multi-Agent Deep reinforcement learning for EV aggregator bidding in Renewable-Dominated electricity markets

Yuanshi Zhang, Haizhou Liu, Amin Mohammadpour Shotorbani, Antônio Carlos Zambroni de Souza, Qinran Hu, Lingqing Meng, A. O. Lebedev
article en

Abstract

• A unified multi-agent market model simulates strategic interactions under high renewable penetration. • The framework combines fleet scheduling and bidding via MADDPG with Prioritized Experience Replay. • Adaptive bidding strategies are learned in continuous action spaces. • The simulation on a 30-bus system proves improved efficiency and reliability versus baselines. The increasing penetration of renewable energy into electricity markets has introduced significant volatility and uncertainty, presenting new challenges for flexible demand-side resources such as Electric Vehicle Aggregators (EVAs). However, existing approaches to EVA bidding strategies often relied on static pricing forecasts or single-agent optimization frameworks, which failed to capture the dynamic, multi-agent nature of modern electricity markets. To address these limitations, this paper proposes an intelligent bidding strategy framework based on Multi-Agent Deep Reinforcement Learning tailored for heavy-duty EV fleets engaged in freight operations. A multi-agent game-theoretic market model is constructed, incorporating renewable generators, traditional suppliers, industrial and commercial users, and EVAs to replicate real-time interactions within spot markets. A joint optimization strategy is developed to align vehicle scheduling constraints with market participation, while the Multi-agent Deep Deterministic Policy Gradient algorithm is employed to enable adaptive, decentralized learning of optimal bidding behaviors. Simulation results demonstrate that the proposed framework effectively reduces peak loads, smooths load profiles, and enhances EVA revenues under volatile market conditions. The findings offer actionable insights into integrating flexible electric mobility into future renewable-dominated power systems.

International Journal of Electrical Power & Energy SystemsVol. 174
Openalex Percentile: Top 60%
Electric Vehicles and Infrastructure
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.