Experience-based integral reinforcement learning consensus for unknown multi-agent systems

This paper investigates an optimal consensus control problem and proposes a policy iteration algorithm based on online integral reinforcement learning for nonlinear multi-agent systems with unknown dynamics. Introducing a critic-actor neural network into the traditional policy iteration avoids the identification of unknown dynamics. To address the issue of local optima in online learning, an experience-based weight-tuning law is introduced to ensure the persistence of excitation conditions during the training phase. The theoretical results show that the system is asymptotically stable, and the network weights converge. Finally, the effectiveness and correctness are verified by several simulation studies.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-09-26
DOI
https://doi.org/10.1038/s41598-025-15573-w
Primary Topic
Adaptive Dynamic Programming Control
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Experience-based integral reinforcement learning consensus for unknown multi-agent systems

Hongnian Yu, Huarong Zhao, Longquan Ma, Yuhao Chen et al.
Scientific Reports
Adaptive Dynamic Programming Control
article

Experience-based integral reinforcement learning consensus for unknown multi-agent systems

Hongnian Yu, Huarong Zhao, Longquan Ma, Yuhao Chen, Yifei Gao
article en

Abstract

This paper investigates an optimal consensus control problem and proposes a policy iteration algorithm based on online integral reinforcement learning for nonlinear multi-agent systems with unknown dynamics. Introducing a critic-actor neural network into the traditional policy iteration avoids the identification of unknown dynamics. To address the issue of local optima in online learning, an experience-based weight-tuning law is introduced to ensure the persistence of excitation conditions during the training phase. The theoretical results show that the system is asymptotically stable, and the network weights converge. Finally, the effectiveness and correctness are verified by several simulation studies.

Scientific ReportsVol. 15(1)
Edinburgh Napier University (GB)
Openalex Percentile: Top 72%
Adaptive Dynamic Programming Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.