Improved deep reinforcement learning based on virtual inertia control in islanded microgrids

One of the most important fundamental challenges in islanded microgrids (IMs) is frequency stability. The reduction in inertia and damping in this system is due to the increasing penetration of renewable energy sources. Virtual inertia control (VIC) is a solution to improve frequency stability in IM. Control methods that have been used for VIC in IM have problems with parameter uncertainty and disturbances and are not adaptable. In this paper, a new method based on improved deep reinforcement learning (IDRL) has been used in the VIC structure, which is obtained by combining three components: (1) The TD3 algorithm has been used to train frequency stability in IM, (2) The hierarchical attention mechanism has been used to focus on the microgrid frequency deviation and reduce the impact of disturbances on it, (3) Meta-learning has been used to quickly adapt to changes in system parameters and disturbances. The proposed method (IDRL) has been compared in several scenarios with the ANN-PI controller and BEL controller in terms of performance against disturbances and parameter uncertainty. The results indicate that the proposed method has achieved an average improvement of 42% in the microgrid frequency deviation and 52% in the settling time of the frequency deviations.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-18
DOI
https://doi.org/10.1038/s41598-026-81202-9
Primary Topic
Microgrid Control and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Improved deep reinforcement learning based on virtual inertia control in islanded microgrids

Sajad Sadr, Farhad Amiri, Arefe Shalbafian
1 links
Scientific Reports
Microgrid Control and Optimization
article

Improved deep reinforcement learning based on virtual inertia control in islanded microgrids

Sajad Sadr, Farhad Amiri, Arefe Shalbafian
article en

Abstract

One of the most important fundamental challenges in islanded microgrids (IMs) is frequency stability. The reduction in inertia and damping in this system is due to the increasing penetration of renewable energy sources. Virtual inertia control (VIC) is a solution to improve frequency stability in IM. Control methods that have been used for VIC in IM have problems with parameter uncertainty and disturbances and are not adaptable. In this paper, a new method based on improved deep reinforcement learning (IDRL) has been used in the VIC structure, which is obtained by combining three components: (1) The TD3 algorithm has been used to train frequency stability in IM, (2) The hierarchical attention mechanism has been used to focus on the microgrid frequency deviation and reduce the impact of disturbances on it, (3) Meta-learning has been used to quickly adapt to changes in system parameters and disturbances. The proposed method (IDRL) has been compared in several scenarios with the ANN-PI controller and BEL controller in terms of performance against disturbances and parameter uncertainty. The results indicate that the proposed method has achieved an average improvement of 42% in the microgrid frequency deviation and 52% in the settling time of the frequency deviations.

Scientific Reports
Hamedan University of Technology (IR), Tafresh University (IR)
Affordable and clean energy, Industry, innovation and infrastructure
Microgrid Control and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon