Microgrid planning in time-division coupling mode for local consumption of RES: A nested reinforcement learning-distributionally robust optimization

• A novel planning framework for the microgrid based on a reconfigurable time-division coupling mode is proposed. • A planning method of nested energy-supply structure search and capacity-operation optimization is proposed. • A DRL-based flexible load aggregation and grouping method is presented. • A two-stage DRO method based on C&CG algorithm is proposed to address high-resolution RES uncertainties. Faced with the insufficient capacity of grids to accommodate renewable energy sources (RESs), many regions in China are stepping up efforts to promote source-load-storage integration within the microgrid (MG), prioritizing RES’s local consumption rather than exporting surplus power to the grid. However, blindly expanding the capacity of energy storage system (ESS) to mitigate RES fluctuations may compromise the economic viability of green RES investments. To address this challenge, this paper proposes a novel planning framework for MGs with flexible loads, based on a reconfigurable time-division coupling mode. By leveraging a clever power distributor (CPD), the framework dynamically matches RESs with flexible loads, enabling direct RES utilization and intuitive visualization of power supply–demand interactions. To solve the discrete programming problem of MG planning under dynamically shifting power supply structures, this paper proposes an integrated planning strategy that nests energy-supply structure search and capacity-operation optimization. In the search layer, the CPD supply structure is determined using a deep reinforcement learning (DRL) algorithm, which achieves faster convergence compared to traditional genetic algorithms. Considering the high-resolution uncertainty in RES outputs, a two-stage distributionally robust optimization based on the C&CG algorithm is employed in the optimization layer. The optimization results are then fed back into the DRL as reward signals to guide subsequent actions. The case studies show the proposed planning method reduces the total costs by 6.7 % and the ESS capacity by 20.8 % compared to traditional coupling mode.

Authors

Institutions

Publication Details

Journal
International Journal of Electrical Power & Energy Systems
Published
2026-01-01
DOI
https://doi.org/10.1016/j.ijepes.2025.111511
Primary Topic
Microgrid Control and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Microgrid planning in time-division coupling mode for local consumption of RES: A nested reinforcement learning-distributionally robust optimization

QuanJun Zhang, A Lian Chen, Jianjing Li, JunYi Wang et al.
International Journal of Electrical Power & Energy Systems
Microgrid Control and Optimization
article

Microgrid planning in time-division coupling mode for local consumption of RES: A nested reinforcement learning-distributionally robust optimization

QuanJun Zhang, A Lian Chen, Jianjing Li, JunYi Wang, Bo Sun, Jianfei Chen, Ke Li, Shihui Su
article en

Abstract

• A novel planning framework for the microgrid based on a reconfigurable time-division coupling mode is proposed. • A planning method of nested energy-supply structure search and capacity-operation optimization is proposed. • A DRL-based flexible load aggregation and grouping method is presented. • A two-stage DRO method based on C&CG algorithm is proposed to address high-resolution RES uncertainties. Faced with the insufficient capacity of grids to accommodate renewable energy sources (RESs), many regions in China are stepping up efforts to promote source-load-storage integration within the microgrid (MG), prioritizing RES’s local consumption rather than exporting surplus power to the grid. However, blindly expanding the capacity of energy storage system (ESS) to mitigate RES fluctuations may compromise the economic viability of green RES investments. To address this challenge, this paper proposes a novel planning framework for MGs with flexible loads, based on a reconfigurable time-division coupling mode. By leveraging a clever power distributor (CPD), the framework dynamically matches RESs with flexible loads, enabling direct RES utilization and intuitive visualization of power supply–demand interactions. To solve the discrete programming problem of MG planning under dynamically shifting power supply structures, this paper proposes an integrated planning strategy that nests energy-supply structure search and capacity-operation optimization. In the search layer, the CPD supply structure is determined using a deep reinforcement learning (DRL) algorithm, which achieves faster convergence compared to traditional genetic algorithms. Considering the high-resolution uncertainty in RES outputs, a two-stage distributionally robust optimization based on the C&CG algorithm is employed in the optimization layer. The optimization results are then fed back into the DRL as reward signals to guide subsequent actions. The case studies show the proposed planning method reduces the total costs by 6.7 % and the ESS capacity by 20.8 % compared to traditional coupling mode.

International Journal of Electrical Power & Energy SystemsVol. 174
Shandong University (CN), Songshan Lake Materials Laboratory (CN)
Affordable and clean energy
Openalex Percentile: Top 96%
Microgrid Control and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.