Hybrid AC/DC Distribution Network Planning Under Renewable Ramp Stress Considering Network-Constrained Flexibility via RL with Feasible Projection

High renewable energy penetration intensifies net-load ramping and increases the demand for operational flexibility in distribution networks. However, existing hybrid AC/DC distribution network planning studies rarely consider both renewable ramp stress and the network deliverability of available flexibility. Furthermore, directly generating discrete investment decisions through reinforcement learning (RL) leads to a large combinatorial action space, making planning feasibility difficult to preserve. To address these issues, this paper proposes a hybrid AC/DC distribution network planning framework under renewable ramp stress, considering network-constrained flexibility via RL with feasible projection. A normalized net-load-ramp feature is incorporated into the planning state to represent stage-dependent renewable ramp stress. Instead of evaluating flexibility solely from resource regulation headroom, the proposed network-constrained flexibility evaluation further considers voltage and line-flow constraints, and the resulting flexibility shortages are incorporated into the planning reward. A mixed-integer feasible-projection model maps the continuous planning priorities learned by proximal policy optimization (PPO) into discrete stage-wise planning schemes. Case studies on modified IEEE 33-bus and IEEE 123-bus systems demonstrate the effectiveness of the proposed framework. In the IEEE 33-bus high-renewable case, the proposed method reduces the discounted total cost by 32.18% relative to rolling mixed-integer linear programming (MILP) while maintaining a zero investment-infeasible-stage rate. For the IEEE 123-bus system, the selected PPO solution reduces the stage-summed load shedding from 57.01 MWh for the AC-only plan and 1.94 MWh for the best of 50 feasible random-priority plans to 0.554 MWh.

Authors

Institutions

Publication Details

Journal
Energies
Published
2026-10-14
DOI
https://doi.org/10.3390/en19204870
Primary Topic
Optimal Power Flow Distribution
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid AC/DC Distribution Network Planning Under Renewable Ramp Stress Considering Network-Constrained Flexibility via RL with Feasible Projection

Ruobing Ling, Shiwei Li, Xuli Wang, Dong Pan et al.
Energies
Optimal Power Flow Distribution
article

Hybrid AC/DC Distribution Network Planning Under Renewable Ramp Stress Considering Network-Constrained Flexibility via RL with Feasible Projection

Ruobing Ling, Shiwei Li, Xuli Wang, Dong Pan, Guang Zeng, Hui Zhang
article en

Abstract

High renewable energy penetration intensifies net-load ramping and increases the demand for operational flexibility in distribution networks. However, existing hybrid AC/DC distribution network planning studies rarely consider both renewable ramp stress and the network deliverability of available flexibility. Furthermore, directly generating discrete investment decisions through reinforcement learning (RL) leads to a large combinatorial action space, making planning feasibility difficult to preserve. To address these issues, this paper proposes a hybrid AC/DC distribution network planning framework under renewable ramp stress, considering network-constrained flexibility via RL with feasible projection. A normalized net-load-ramp feature is incorporated into the planning state to represent stage-dependent renewable ramp stress. Instead of evaluating flexibility solely from resource regulation headroom, the proposed network-constrained flexibility evaluation further considers voltage and line-flow constraints, and the resulting flexibility shortages are incorporated into the planning reward. A mixed-integer feasible-projection model maps the continuous planning priorities learned by proximal policy optimization (PPO) into discrete stage-wise planning schemes. Case studies on modified IEEE 33-bus and IEEE 123-bus systems demonstrate the effectiveness of the proposed framework. In the IEEE 33-bus high-renewable case, the proposed method reduces the discounted total cost by 32.18% relative to rolling mixed-integer linear programming (MILP) while maintaining a zero investment-infeasible-stage rate. For the IEEE 123-bus system, the selected PPO solution reduces the stage-summed load shedding from 57.01 MWh for the AC-only plan and 1.94 MWh for the best of 50 feasible random-priority plans to 0.554 MWh.

EnergiesVol. 19(20)
State Grid Corporation of China (China) (CN), Shanghai Electric (China) (CN), Economic Research Institute (BG)
Affordable and clean energy, Industry, innovation and infrastructure
Openalex Percentile: Top 24%
Optimal Power Flow Distribution
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.