Adaptive Deep Reinforcement Learning for VVC in High DER-Integrated Distribution Grids

The increasing penetration of Distributed Energy Resources (DERs) in modern distribution grids has created sig-nificant challenges in maintaining voltage profiles and minimizing reactive power losses. While Deep Reinforcement Learning (DRL) approaches have been explored for Volt/VAR Control (VVC), existing methods often rely on single-agent frameworks or lack adaptive mechanisms to balance competing grid objectives dy-namically. Multi-Agent (MA) DRL frameworks have emerged but typically require explicit inter-agent communication, limiting scalability and practicality. To address these limitations, we propose a novel MA-DRL framework that incorporates adaptive reward computation to implicitly coordinate special-ized agents, including a Voltage Control Agent for maintaining voltage profiles and a Reactive Power Agent for optimizing reactive power dispatch. Unlike prior approaches, our method dynamically adjusts local and global rewards based on real-time grid conditions, enabling scalable and efficient grid control without explicit inter-agent communication. We evaluated the framework on the IEEE 123-bus test system under high DER penetration. The results demonstrated that the proposed MA-DRL approach successfully eliminated voltage violations, reduced power losses through optimized reactive power dispatch, and decreased transformer tap changes and capacitor operations, thereby extending equipment lifespan. These results demonstrate the scalability and practicality of adaptive reward-based MA-DRL for addressing modern grid management challenges.

Authors

Institutions

Publication Details

Published
2025-02-10
DOI
https://doi.org/10.1109/tpec63981.2025.10906926
Citations
1
Primary Topic
Electric Power System Optimization
Type
article
Field-Weighted Citation Impact
0.73

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Deep Reinforcement Learning for VVC in High DER-Integrated Distribution Grids

Gelli Ravikumar, Sai Chandana Vallam Kondu
1 citations
Electric Power System Optimization
0.73
article

Adaptive Deep Reinforcement Learning for VVC in High DER-Integrated Distribution Grids

Gelli Ravikumar, Sai Chandana Vallam Kondu
article en
1 citations

Abstract

The increasing penetration of Distributed Energy Resources (DERs) in modern distribution grids has created sig-nificant challenges in maintaining voltage profiles and minimizing reactive power losses. While Deep Reinforcement Learning (DRL) approaches have been explored for Volt/VAR Control (VVC), existing methods often rely on single-agent frameworks or lack adaptive mechanisms to balance competing grid objectives dy-namically. Multi-Agent (MA) DRL frameworks have emerged but typically require explicit inter-agent communication, limiting scalability and practicality. To address these limitations, we propose a novel MA-DRL framework that incorporates adaptive reward computation to implicitly coordinate special-ized agents, including a Voltage Control Agent for maintaining voltage profiles and a Reactive Power Agent for optimizing reactive power dispatch. Unlike prior approaches, our method dynamically adjusts local and global rewards based on real-time grid conditions, enabling scalable and efficient grid control without explicit inter-agent communication. We evaluated the framework on the IEEE 123-bus test system under high DER penetration. The results demonstrated that the proposed MA-DRL approach successfully eliminated voltage violations, reduced power losses through optimized reactive power dispatch, and decreased transformer tap changes and capacitor operations, thereby extending equipment lifespan. These results demonstrate the scalability and practicality of adaptive reward-based MA-DRL for addressing modern grid management challenges.

Iowa State University (US)
National Science Foundation
Industry, innovation and infrastructure
Openalex Percentile: Top 31%
Electric Power System Optimization
0.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Adaptive Deep Reinforcement Learning for VVC in High DER-Integrated Distribution Grids — Gelli Ravikumar, Sai Chandana Vallam Kondu · (2025) | TGRS Research Map | TGRS