From Classical Control to Deep Reinforcement Learning: A Reproducible Framework for Quadrotor Modeling and Control

Unmanned aerial vehicles used in delivery applications must maintain reliable trajectory tracking despite payload variations that alter the vehicle dynamics. This study compares seven control strategies—proportional–integral–derivative (PID), linear quadratic regulator (LQR), linear quadratic integral (LQI), linear model predictive control (MPC), nonlinear MPC (NMPC), Adaptive NMPC, and Soft Actor–Critic (SAC)—for a nonlinear quadrotor under nominal conditions, staged payload-mass variation, and measurement noise. All controllers are evaluated using the same vehicle model, actuator constraints, and four benchmark trajectories. The comparison considers tracking accuracy, robustness, estimated mechanical propulsion power, actuator saturation, benchmark completion, noise sensitivity, and computational burden. Under nominal conditions, NMPC and Adaptive NMPC achieve nearly identical tracking, with a maximum difference in three-dimensional root-mean-square error (3D RMSE) of approximately 4.5 × 10−4 m. Under staged payload-mass variation, Adaptive NMPC completes all four trajectories without divergence, whereas fixed-model NMPC remains bounded only in Hover and diverges on the three moving trajectories. In the Hover case, adaptation reduces the 3D RMSE by 80.2% (from 0.3085 m to 0.0611 m). SAC exhibits pronounced trajectory- and seed-dependent performance; the representative policy (Seed 1) completes only 3 of the 8 nominal and staged-mass benchmarks at full duration. These results demonstrate that strong nominal tracking alone does not guarantee robustness to payload variation, and they highlight the benefit of online model adaptation for quadrotor control under changing mass conditions.

Authors

Institutions

Publication Details

Journal
Machines
Published
2026-11-16
DOI
https://doi.org/10.3390/machines14111359
Primary Topic
Adaptive Control of Nonlinear Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

From Classical Control to Deep Reinforcement Learning: A Reproducible Framework for Quadrotor Modeling and Control

M. M. Ahmad, Rabab Benotsmane, Ameer Abdul Hannan, Ziad Mobark
3 links
Machines
Adaptive Control of Nonlinear Systems
article

From Classical Control to Deep Reinforcement Learning: A Reproducible Framework for Quadrotor Modeling and Control

M. M. Ahmad, Rabab Benotsmane, Ameer Abdul Hannan, Ziad Mobark
article en

Abstract

Unmanned aerial vehicles used in delivery applications must maintain reliable trajectory tracking despite payload variations that alter the vehicle dynamics. This study compares seven control strategies—proportional–integral–derivative (PID), linear quadratic regulator (LQR), linear quadratic integral (LQI), linear model predictive control (MPC), nonlinear MPC (NMPC), Adaptive NMPC, and Soft Actor–Critic (SAC)—for a nonlinear quadrotor under nominal conditions, staged payload-mass variation, and measurement noise. All controllers are evaluated using the same vehicle model, actuator constraints, and four benchmark trajectories. The comparison considers tracking accuracy, robustness, estimated mechanical propulsion power, actuator saturation, benchmark completion, noise sensitivity, and computational burden. Under nominal conditions, NMPC and Adaptive NMPC achieve nearly identical tracking, with a maximum difference in three-dimensional root-mean-square error (3D RMSE) of approximately 4.5 × 10−4 m. Under staged payload-mass variation, Adaptive NMPC completes all four trajectories without divergence, whereas fixed-model NMPC remains bounded only in Hover and diverges on the three moving trajectories. In the Hover case, adaptation reduces the 3D RMSE by 80.2% (from 0.3085 m to 0.0611 m). SAC exhibits pronounced trajectory- and seed-dependent performance; the representative policy (Seed 1) completes only 3 of the 8 nominal and staged-mass benchmarks at full duration. These results demonstrate that strong nominal tracking alone does not guarantee robustness to payload variation, and they highlight the benefit of online model adaptation for quadrotor control under changing mass conditions.

MachinesVol. 14(11)
University of Doha for Science and Technology (QA)
Adaptive Control of Nonlinear Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon