Optimal Trajectory and Control Strategy Generation for Aerobatic Maneuvers in Fixed-Wing UAVs Based on QAEP-SAC

To address the challenges of generating autonomous, high-quality control laws for high-performance Unmanned Aerial Vehicles (UAVs) performing long-horizon complex aerobatic maneuvers, specifically the difficulty of achieving energy-altitude closure, low-level control chattering, and low utilization of high-quality experience, this paper proposes an improved Soft Actor-Critic (SAC) algorithm incorporating a Quality-Aware Expert Pool (QAEP). Using the aerobatic loop maneuver as a representative scenario, this study explores the autonomous generation of control-surface manipulation policies comparable to those of skilled human pilots for agile fixed-wing UAVs. First, a singularity-free feature state representation and a rate-integrated action space are constructed. Combined with a symmetric shaping reward, these suppress control chattering at the physical level and achieve energy-altitude closure throughout the maneuver. Second, a dual-threshold expert pool driven by task reward and trajectory quality, together with a progressive mixed-sampling mechanism, is designed to effectively filter out low-quality samples and improve algorithmic convergence stability. Simulation experiments based on JSBSim with a high-fidelity F-16 model, which serves as a representative surrogate for a high-performance UAV, demonstrate that the proposed method generates maneuver strategies with manipulation quality comparable to that of skilled human pilots. The Dynamic Time Warping (DTW) similarity between the generated control commands and human expert demonstration data exceeds 0.97, the Manipulation Smoothness Index (MSI) is improved by 7.3%, and the loop completion rate under randomized initial conditions reaches 96.2%. These results suggest that the proposed framework enables human-like energy coordination and fine-grained control sequence generation in complex simulation environments, offering a promising approach to advancing maneuver intelligence and autonomous control capability in UAV systems.