Bounded Residual Reinforcement Learning-Augmented MRAC for Nonlinear Pitch-Axis Tracking of an Aerial Platform
This study investigates the integration of reinforcement learning (RL) with Model Reference Adaptive Control (MRAC) to improve pitch-axis tracking of an aerial platform operating under nonlinear dynamics and external disturbances. A hybrid RL-MRAC framework is developed by augmenting a conventional linear MRAC controller with a bounded, online reinforcement-learning component based on SARSA-inspired temporal-difference learning. The proposed approach learns corrective control actions without requiring prior offline training or explicit knowledge of the plant’s nonlinear dynamics. A Lyapunov-based stability analysis is presented to characterize the tracking behavior under bounded uncertainties and specified adaptive-parameter assumptions. The proposed controller is evaluated through MATLAB simulations and compared with conventional Linear-MRAC, Nonlinear-MRAC, and radial basis function neural-network MRAC. The evaluation considers multiple reference trajectories, external disturbances, nonlinear parameter variations, measurement noise, and actuator constraints. Simulation results demonstrate that RL-MRAC can improve tracking performance under selected operating conditions. In the representative sinusoidal-disturbance case, the proposed controller achieves reductions of 3.64% in integral absolute error and 6.05% in integral time-weighted absolute error compared with Linear-MRAC. However, repeated simulations reveal that the improvements are dependent on the operating conditions and are accompanied by increased control-input variation. These findings demonstrate the potential of bounded residual reinforcement learning as an adaptive compensation strategy while highlighting the importance of learning design, robustness, and actuator limitations in practical applications.
Authors
- Bara J. Emran (ORCID: https://orcid.org/0000-0002-2927-2689)
- Abdelrehim A. Elembaby (ORCID: https://orcid.org/0009-0003-6091-1877)
Institutions
- American University of Sharjah (AE)
Publication Details
- Journal
- Machines
- Published
- 2026-11-19
- DOI
- https://doi.org/10.3390/machines14111380
- Primary Topic
- Adaptive Control of Nonlinear Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00