Learning Event‐Triggered Model Predictive Control From Data With Hierarchical Reinforcement Learning
ABSTRACT The increasing scale of industrial systems has imposed higher demands on the accuracy and real‐time performance of control systems. Event‐triggered model predictive control (MPC) improves overall system efficiency by reducing unnecessary control computations; however, it heavily relies on accurate system models and extensive domain knowledge. This article proposes a novel event‐triggered MPC framework based on hierarchical reinforcement learning (HRL), which mitigates the dependency on precise models and prior knowledge through a data‐driven approach. The proposed method decomposes the event‐triggered MPC task into two interconnected components: High‐level triggering decisions and low‐level control input generation. The high‐level policy designs a more generalizable triggering mechanism based on a global reward signal to dynamically determine when control updates should be executed. The low‐level policy, guided by the high‐level decisions and internal rewards, learns an approximate control strategy. This hierarchical structure effectively captures the layered relationship and dynamic interaction between triggering and control, thereby enhancing both the interpretability and training efficiency of the learning policies. Moreover, the paper introduces a stability verification and policy improvement mechanism by constructing Lyapunov functions directly from data. Experimental results on both linear and nonlinear systems demonstrate the proposed method's significant advantages in terms of learning efficiency, control performance, and system stability.
Authors
- Shaoyuan Li (ORCID: https://orcid.org/0000-0003-3427-2912)
- Rui Ren (ORCID: https://orcid.org/0000-0001-7899-9107)
Institutions
- Shanghai Jiao Tong University (CN)
Publication Details
- Journal
- International Journal of Robust and Nonlinear Control
- Published
- 2025-08-05
- DOI
- https://doi.org/10.1002/rnc.70102
- Primary Topic
- Advanced Control Systems Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China