Q‐Learning for Finite‐Horizon Decentralized Linear‐Quadratic Optimal Control Problem

ABSTRACT This article studies the finite‐horizon decentralized linear‐quadratic optimal control problem of large‐scale systems. The main feature of this article is that there are two controllers in the system, and each controller can only access its own measurement information, but not that of the other controller. In particular, the system matrices are unknown when designing the controller. The contribution of this article is designing a Q‐learning algorithm for the optimal control problem by deriving decentralized Q‐functions based on different measurement information. The effectiveness of the proposed algorithm is verified by two numerical examples.

Authors

Institutions

Publication Details

Journal
Optimal Control Applications and Methods
Published
2025-08-12
DOI
https://doi.org/10.1002/oca.70018
Primary Topic
Adaptive Dynamic Programming Control
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Q‐Learning for Finite‐Horizon Decentralized Linear‐Quadratic Optimal Control Problem

Jianwei Xia, Wei Wang, Juanjuan Xu, Wenjing Yang
Optimal Control Applications and Methods
Adaptive Dynamic Programming Control
article

Q‐Learning for Finite‐Horizon Decentralized Linear‐Quadratic Optimal Control Problem

Jianwei Xia, Wei Wang, Juanjuan Xu, Wenjing Yang
article en

Abstract

ABSTRACT This article studies the finite‐horizon decentralized linear‐quadratic optimal control problem of large‐scale systems. The main feature of this article is that there are two controllers in the system, and each controller can only access its own measurement information, but not that of the other controller. In particular, the system matrices are unknown when designing the controller. The contribution of this article is designing a Q‐learning algorithm for the optimal control problem by deriving decentralized Q‐functions based on different measurement information. The effectiveness of the proposed algorithm is verified by two numerical examples.

Optimal Control Applications and MethodsVol. 46(6)
Shandong University (CN), Liaocheng University (CN)
Natural Science Foundation of Shandong Province
Openalex Percentile: Top 78%
Adaptive Dynamic Programming Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.