Reinforcement Learning-Based PI Control Strategy for Single-Phase Voltage Source PWM Rectifier

To address issues of lagging dynamic response and complex parameter tuning in traditional double-loop control of single-phase voltage source PWM rectifiers, this research proposes a hierarchical intelligent control strategy integrating reinforcement learning (RL). Firstly, the mathematical model in the d-q rotating coordinate system is established by analyzing the circuit topology of a single-phase VSR. Subsequently, a double-loop control structure comprising a voltage outer loop and a current inner loop is developed: the current inner loop adopts DQ feedforward decoupling control to achieve independent conditions; the voltage outer loop innovatively employs a single-neuron PI controller based on reinforcement learning, which optimizes control parameters in real-time via a deep deterministic policy gradient (DDPG) algorithm, thus forming an adaptive hierarchical control system. Finally, the effectiveness of the strategy is validated through simulation models built on the Matlab/Simulink platform. Simulation results demonstrate superior dynamic performance of the proposed method under load mutation conditions, significantly improving dynamic response quality and steady-state performance.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2025-05-29
DOI
https://doi.org/10.54254/2755-2721/2025.kl23544
Primary Topic
Multilevel Inverters and Converters
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reinforcement Learning-Based PI Control Strategy for Single-Phase Voltage Source PWM Rectifier

Linzheng Wang
Applied and Computational Engineering
Multilevel Inverters and Converters
article

Reinforcement Learning-Based PI Control Strategy for Single-Phase Voltage Source PWM Rectifier

Linzheng Wang
article en

Abstract

To address issues of lagging dynamic response and complex parameter tuning in traditional double-loop control of single-phase voltage source PWM rectifiers, this research proposes a hierarchical intelligent control strategy integrating reinforcement learning (RL). Firstly, the mathematical model in the d-q rotating coordinate system is established by analyzing the circuit topology of a single-phase VSR. Subsequently, a double-loop control structure comprising a voltage outer loop and a current inner loop is developed: the current inner loop adopts DQ feedforward decoupling control to achieve independent conditions; the voltage outer loop innovatively employs a single-neuron PI controller based on reinforcement learning, which optimizes control parameters in real-time via a deep deterministic policy gradient (DDPG) algorithm, thus forming an adaptive hierarchical control system. Finally, the effectiveness of the strategy is validated through simulation models built on the Matlab/Simulink platform. Simulation results demonstrate superior dynamic performance of the proposed method under load mutation conditions, significantly improving dynamic response quality and steady-state performance.

Applied and Computational EngineeringVol. 161(1)
Qingdao University of Technology (CN)
Openalex Percentile: Top 90%
Multilevel Inverters and Converters
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.