Bounded Residual Reinforcement Learning-Augmented MRAC for Nonlinear Pitch-Axis Tracking of an Aerial Platform

This study investigates the integration of reinforcement learning (RL) with Model Reference Adaptive Control (MRAC) to improve pitch-axis tracking of an aerial platform operating under nonlinear dynamics and external disturbances. A hybrid RL-MRAC framework is developed by augmenting a conventional linear MRAC controller with a bounded, online reinforcement-learning component based on SARSA-inspired temporal-difference learning. The proposed approach learns corrective control actions without requiring prior offline training or explicit knowledge of the plant’s nonlinear dynamics. A Lyapunov-based stability analysis is presented to characterize the tracking behavior under bounded uncertainties and specified adaptive-parameter assumptions. The proposed controller is evaluated through MATLAB simulations and compared with conventional Linear-MRAC, Nonlinear-MRAC, and radial basis function neural-network MRAC. The evaluation considers multiple reference trajectories, external disturbances, nonlinear parameter variations, measurement noise, and actuator constraints. Simulation results demonstrate that RL-MRAC can improve tracking performance under selected operating conditions. In the representative sinusoidal-disturbance case, the proposed controller achieves reductions of 3.64% in integral absolute error and 6.05% in integral time-weighted absolute error compared with Linear-MRAC. However, repeated simulations reveal that the improvements are dependent on the operating conditions and are accompanied by increased control-input variation. These findings demonstrate the potential of bounded residual reinforcement learning as an adaptive compensation strategy while highlighting the importance of learning design, robustness, and actuator limitations in practical applications.

Authors

Institutions

Publication Details

Journal
Machines
Published
2026-11-19
DOI
https://doi.org/10.3390/machines14111380
Primary Topic
Adaptive Control of Nonlinear Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Bounded Residual Reinforcement Learning-Augmented MRAC for Nonlinear Pitch-Axis Tracking of an Aerial Platform

Bara J. Emran, Abdelrehim A. Elembaby
Machines
Adaptive Control of Nonlinear Systems
article

Bounded Residual Reinforcement Learning-Augmented MRAC for Nonlinear Pitch-Axis Tracking of an Aerial Platform

Bara J. Emran, Abdelrehim A. Elembaby
article en

Abstract

This study investigates the integration of reinforcement learning (RL) with Model Reference Adaptive Control (MRAC) to improve pitch-axis tracking of an aerial platform operating under nonlinear dynamics and external disturbances. A hybrid RL-MRAC framework is developed by augmenting a conventional linear MRAC controller with a bounded, online reinforcement-learning component based on SARSA-inspired temporal-difference learning. The proposed approach learns corrective control actions without requiring prior offline training or explicit knowledge of the plant’s nonlinear dynamics. A Lyapunov-based stability analysis is presented to characterize the tracking behavior under bounded uncertainties and specified adaptive-parameter assumptions. The proposed controller is evaluated through MATLAB simulations and compared with conventional Linear-MRAC, Nonlinear-MRAC, and radial basis function neural-network MRAC. The evaluation considers multiple reference trajectories, external disturbances, nonlinear parameter variations, measurement noise, and actuator constraints. Simulation results demonstrate that RL-MRAC can improve tracking performance under selected operating conditions. In the representative sinusoidal-disturbance case, the proposed controller achieves reductions of 3.64% in integral absolute error and 6.05% in integral time-weighted absolute error compared with Linear-MRAC. However, repeated simulations reveal that the improvements are dependent on the operating conditions and are accompanied by increased control-input variation. These findings demonstrate the potential of bounded residual reinforcement learning as an adaptive compensation strategy while highlighting the importance of learning design, robustness, and actuator limitations in practical applications.

MachinesVol. 14(11)
American University of Sharjah (AE)
Adaptive Control of Nonlinear Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon