Event-Driven Based Reinforcement Learning Predictive Controller Design for Three-Phase NPC Converters Using Online Approximators

This article is concerned with a two-step event-driven in reinforcement learning model-free predictive control problem leveraging online approximators for power converter systems, in which the limitations from system uncertainties and unnecessary switching loss are all addressed. To be specific, the key features of this technical note are: 1) a critic neural network to learn the performance function in real-time; 2) an actor neural network to approximate the predictive controller online and to minimize the learned performance function obtained from the critic network; 3) a two-step event-driven control protocol to attenuate the switching frequency (SF). Also, we further discuss the sensitivity of the proposal to parametric uncertainties and quantify its performance under low SF operation and unknown disturbances conditions. Further, the convergence analysis of the networks' weight estimation errors is manifested. Finally, we evaluate the suggested controller by means of various numerical examples, and the results found are promising and motivate further research in this field.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Power Electronics
Published
2024-12-04
DOI
https://doi.org/10.1109/tpel.2024.3510731
Citations
32
Primary Topic
Multilevel Inverters and Converters
Type
article
Field-Weighted Citation Impact
6.68

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Event-Driven Based Reinforcement Learning Predictive Controller Design for Three-Phase NPC Converters Using Online Approximators

Yongdong Li, Kui Wang, José Rodríguez, Youtong Fang et al.
32 citations
IEEE Transactions on Power Electronics
Multilevel Inverters and Converters
6.68
article

Event-Driven Based Reinforcement Learning Predictive Controller Design for Three-Phase NPC Converters Using Online Approximators

Yongdong Li, Kui Wang, José Rodríguez, Youtong Fang, Xing Liu, Lin Qiu
article en
32 citations

Abstract

This article is concerned with a two-step event-driven in reinforcement learning model-free predictive control problem leveraging online approximators for power converter systems, in which the limitations from system uncertainties and unnecessary switching loss are all addressed. To be specific, the key features of this technical note are: 1) a critic neural network to learn the performance function in real-time; 2) an actor neural network to approximate the predictive controller online and to minimize the learned performance function obtained from the critic network; 3) a two-step event-driven control protocol to attenuate the switching frequency (SF). Also, we further discuss the sensitivity of the proposal to parametric uncertainties and quantify its performance under low SF operation and unknown disturbances conditions. Further, the convergence analysis of the networks' weight estimation errors is manifested. Finally, we evaluate the suggested controller by means of various numerical examples, and the results found are promising and motivate further research in this field.

IEEE Transactions on Power ElectronicsVol. 40(4)
San Sebastián University (CL), Shanghai Dianji University (CN), Zhejiang University (CN), Tsinghua University (CN)
Ministry of Education, Libya, Agencia Nacional de Investigación y Desarrollo, Natural Science Foundation of Zhejiang Province
Openalex Percentile: Top 3%
Multilevel Inverters and Converters
6.68
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.