Global ${H_{\infty }}$ Output Regulation of Nonlinear Systems via Output-Feedback Reinforcement Learning

This paper addresses the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$H_{\infty }$</tex-math></inline-formula> output regulation problem of affine nonlinear systems with unmeasurable states and completely unknown dynamics. The <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$H_{\infty }$</tex-math></inline-formula> output regulation problem is formulated into a two-player zero-sum differential game problem with the control input and disturbance being the two adversary players. A model-based global state- feedback optimal solution to the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$H_{\infty }$</tex-math></inline-formula> output regulation problem is presented by solving a Hamilton-Jacobi-Isaacs (HJI) equation, and a state- feedback reinforcement learning (RL) algorithm is proposed to solve the HJI equation without knowledge of system dynamics. A linear data-driven observer is designed to estimate the unmeasurable states and a novel output- feedback RL algorithm is developed based on the state- feedback RL framework by employing a critic-actor-disturbance neural network (NN) with a hidden layer. The salient found of this work is that, under the proposed output- feedback RL algorithm, the closed-loop system can reach globally stable. A numerical example is provided to demonstrate the effectiveness of the proposed solution.