Dual-Agent Deep Reinforcement Learning for Low-Carbon Economic Dispatch in Wind-Integrated Microgrids Based on Carbon Emission Flow
High renewable penetration in microgrids makes low-carbon economic dispatch under uncertainty challenging, and single-agent deep reinforcement learning (DRL) often yields unstable cost–emission trade-offs. This study proposes a dual-agent DRL framework that explicitly balances operational economy and environmental sustainability. A Proximal Policy Optimization (PPO) agent focuses on minimizing operating cost, while a Soft Actor–Critic (SAC) agent targets carbon emission reduction; their actions are combined through an adaptive weighting strategy. The framework is supported by carbon emission flow (CEF) theory, which enables network-level tracing of carbon flows, and a stepped carbon pricing mechanism that internalizes dynamic carbon costs. Demand response (DR) is incorporated to enhance operational flexibility. The dispatch problem is formulated as a Markov Decision Process, allowing the dual-agent system to learn policies through interaction with the environment. Case studies on a modified PJM 5-bus test system show that, compared with a Deep Deterministic Policy Gradient (DDPG) baseline, the proposed method reduces total operating cost, carbon emissions, and wind curtailment by 16.8%, 11.3%, and 15.2%, respectively. These results demonstrate that the proposed framework is an effective solution for economical and low-carbon operation in renewable-rich power systems.
Authors
- Xiaoxiao Yu (ORCID: https://orcid.org/0000-0002-5011-049X)
- Hebin Ruan
- Yuhang Li (ORCID: https://orcid.org/0000-0002-2410-9356)
- Wenjun Qiu
- Yicheng Liu
- Zhiyi He
Institutions
- Nanjing University of Information Science and Technology (CN)
- Nanjing University of Science and Technology (CN)
- Global Energy Interconnection Research Institute North America (US)
Publication Details
- Journal
- Energies
- Published
- 2026-01-22
- DOI
- https://doi.org/10.3390/en19020551
- Primary Topic
- Electric Power System Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00