Deep reinforcement learning LQR controller design for MIMO systems applied to gas production facility

This paper addresses performance control in the synthesis of a stabilising controller for a gas production facility. The controller's performance is closely linked to the pole values defined during synthesis. However, it is highlighted that these calculated pole values may not always be applicable due to the system's physical constraints, such as the impossibility of reducing a biological chemical reaction from hours to microseconds. Initially, the controller is synthesised using an LQR controller with state estimators generated by a specific observer. An in-depth discussion of pole values is provided, referencing Hadamard's lemma, Gerschgorin discs, and the Nyquist stability criterion. To enhance stabilisation performance, Deep Reinforcement Learning is employed to modify the poles by adjusting LQR values in a learning environment. The results demonstrate a successful integration of Gerschgorin discs early in the synthesis process, followed by Deep Reinforcement Learning improvements, generating physically feasible pole values that significantly enhance controller performance.

Authors

Institutions

Publication Details

Journal
International Journal of Automation and Control
Published
2024-10-22
DOI
https://doi.org/10.1504/ijaac.2025.10067319
Primary Topic
Advanced Control Systems Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep reinforcement learning LQR controller design for MIMO systems applied to gas production facility

Mongi Besbes, Zied Tmar, Kamel Ben Slimane
International Journal of Automation and Control
Advanced Control Systems Design
article

Deep reinforcement learning LQR controller design for MIMO systems applied to gas production facility

Mongi Besbes, Zied Tmar, Kamel Ben Slimane
article en

Abstract

This paper addresses performance control in the synthesis of a stabilising controller for a gas production facility. The controller's performance is closely linked to the pole values defined during synthesis. However, it is highlighted that these calculated pole values may not always be applicable due to the system's physical constraints, such as the impossibility of reducing a biological chemical reaction from hours to microseconds. Initially, the controller is synthesised using an LQR controller with state estimators generated by a specific observer. An in-depth discussion of pole values is provided, referencing Hadamard's lemma, Gerschgorin discs, and the Nyquist stability criterion. To enhance stabilisation performance, Deep Reinforcement Learning is employed to modify the poles by adjusting LQR values in a learning environment. The results demonstrate a successful integration of Gerschgorin discs early in the synthesis process, followed by Deep Reinforcement Learning improvements, generating physically feasible pole values that significantly enhance controller performance.

International Journal of Automation and ControlVol. 19(1)
Tunis University (TN), University of Carthage (TN), Tunis El Manar University (TN)
Openalex Percentile: Top 79%
Advanced Control Systems Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.