RL‐Based H∞ Optimal Tracking Control for Markov Jump Singularly Perturbed Systems

ABSTRACT In this article, the reinforcement learning (RL)‐based optimal tracking control for a class of discrete‐time Markov jump singularly perturbed systems (MJSPSs) is investigated under the conditions of unknown system dynamics and external disturbances. First, an augmented system is constructed by integrating the reference model with the system dynamics, upon which a zero‐sum game performance index is established. Consequently, the corresponding coupled game algebraic Riccati equation (CGARE) and the ‐function Bellman equation are derived. Subsequently, a model‐free ‐learning algorithm is proposed to approximate the optimal solution of the CGARE by utilizing collected input‐state data, eliminating the reliance on precise system models. Finally, the effectiveness of the proposed method is validated through a tunnel diode circuit simulation, where stable tracking performance is achieved in the presence of external disturbances.

Authors

Institutions

Publication Details

Journal
Optimal Control Applications and Methods
Published
2026-11-06
DOI
https://doi.org/10.1002/oca.70153
Primary Topic
Adaptive Dynamic Programming Control
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

RL‐Based H∞ Optimal Tracking Control for Markov Jump Singularly Perturbed Systems

Kaibo Shi, Jinde Cao, Wenhai Qi, Jun Sheng Cheng et al.
Optimal Control Applications and Methods
Adaptive Dynamic Programming Control
article

RL‐Based H∞ Optimal Tracking Control for Markov Jump Singularly Perturbed Systems

Kaibo Shi, Jinde Cao, Wenhai Qi, Jun Sheng Cheng, Xuewen Shi, Luyu Liu
article en

Abstract

ABSTRACT In this article, the reinforcement learning (RL)‐based optimal tracking control for a class of discrete‐time Markov jump singularly perturbed systems (MJSPSs) is investigated under the conditions of unknown system dynamics and external disturbances. First, an augmented system is constructed by integrating the reference model with the system dynamics, upon which a zero‐sum game performance index is established. Consequently, the corresponding coupled game algebraic Riccati equation (CGARE) and the ‐function Bellman equation are derived. Subsequently, a model‐free ‐learning algorithm is proposed to approximate the optimal solution of the CGARE by utilizing collected input‐state data, eliminating the reliance on precise system models. Finally, the effectiveness of the proposed method is validated through a tunnel diode circuit simulation, where stable tracking performance is achieved in the presence of external disturbances.

Optimal Control Applications and Methods
Qufu Normal University (CN), Guangxi Normal University (CN), Chengdu University (CN), Southeast University (CN)
Openalex Percentile: Top 22%
Adaptive Dynamic Programming Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon