An Unknown Multiplayer Nonzero-Sum Game: Prescribed-Time Dynamic Event-Triggered Control via Adaptive Dynamic Programming

In this paper, the novel prescribed-time dynamic event-triggered control method of an unknown multiplayer nonzero-sum game (MP-NZSG) is designed by using adaptive dynamic programming (ADP). Firstly, a neural network-based identifier is constructed to estimate the unknown system dynamics. Subsequently, a novel ADP-based dynamic event-triggered control approach is advanced to ensure optimality and prescribed-time stability. A critic neural network (NN) is established for each player to approximate the Nash equilibrium solution of the dynamic event-triggered Hamilton-Jacobi-Isaacs (HJI) equation. This network employs a novel weight updating law, based on the experience replay technique, to alleviate the persistence of excitation condition. Furthermore, using the Lyapunov method, the uniform limit boundedness analysis of the neural network approximation error and multiplayer system is validated. Additionally, minimum inter-event time (MIET) is conclusively established to mitigate the notorious Zeno behaviour. Ultimately, the efficacy of the proposed method is rigorously substantiated through comprehensive simulation results. Note to Practitioners—Our research addresses the challenges of multi-component coordinated control, particularly in spacecraft attitude control. To handle these complexities, we propose an innovative adaptive dynamic event-triggered control approach. By integrating adaptive dynamic programming and neural networks, we effectively model and manage unknown system dynamics, enhancing the controller’s adaptability and robustness. Dynamic event-triggered policies are introduced to optimize system performance and reduce computational costs. The ADP-based prescribed time optimal control scheme prioritizes steady-state performance of nonlinear nonaffine systems, ensuring precise task completion within specified timeframes. Additionally, experience replay technology further fortifies the controller’s learning and adaptability to dynamic environments.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Automation Science and Engineering
Published
2024-10-28
DOI
https://doi.org/10.1109/tase.2024.3484412
Citations
41
Primary Topic
Adaptive Dynamic Programming Control
Type
article
Field-Weighted Citation Impact
14.82

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Unknown Multiplayer Nonzero-Sum Game: Prescribed-Time Dynamic Event-Triggered Control via Adaptive Dynamic Programming

José de Jesús Rubio, Zhixuan Zhang, Kun Zhang, Xiang Peng Xie
41 citations
IEEE Transactions on Automation Science and Engineering
Adaptive Dynamic Programming Control
14.82
article

An Unknown Multiplayer Nonzero-Sum Game: Prescribed-Time Dynamic Event-Triggered Control via Adaptive Dynamic Programming

José de Jesús Rubio, Zhixuan Zhang, Kun Zhang, Xiang Peng Xie
article en
41 citations

Abstract

In this paper, the novel prescribed-time dynamic event-triggered control method of an unknown multiplayer nonzero-sum game (MP-NZSG) is designed by using adaptive dynamic programming (ADP). Firstly, a neural network-based identifier is constructed to estimate the unknown system dynamics. Subsequently, a novel ADP-based dynamic event-triggered control approach is advanced to ensure optimality and prescribed-time stability. A critic neural network (NN) is established for each player to approximate the Nash equilibrium solution of the dynamic event-triggered Hamilton-Jacobi-Isaacs (HJI) equation. This network employs a novel weight updating law, based on the experience replay technique, to alleviate the persistence of excitation condition. Furthermore, using the Lyapunov method, the uniform limit boundedness analysis of the neural network approximation error and multiplayer system is validated. Additionally, minimum inter-event time (MIET) is conclusively established to mitigate the notorious Zeno behaviour. Ultimately, the efficacy of the proposed method is rigorously substantiated through comprehensive simulation results. Note to Practitioners—Our research addresses the challenges of multi-component coordinated control, particularly in spacecraft attitude control. To handle these complexities, we propose an innovative adaptive dynamic event-triggered control approach. By integrating adaptive dynamic programming and neural networks, we effectively model and manage unknown system dynamics, enhancing the controller’s adaptability and robustness. Dynamic event-triggered policies are introduced to optimize system performance and reduce computational costs. The ADP-based prescribed time optimal control scheme prioritizes steady-state performance of nonlinear nonaffine systems, ensuring precise task completion within specified timeframes. Additionally, experience replay technology further fortifies the controller’s learning and adaptability to dynamic environments.

IEEE Transactions on Automation Science and EngineeringVol. 22
Nanjing University of Posts and Telecommunications (CN), Instituto Politécnico Nacional (MX), Beihang University (CN)
National Natural Science Foundation of China, Beijing Nova Program, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 1%
Adaptive Dynamic Programming Control
14.82
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.