Phase-Adaptive Reinforcement Learning for Self-Tuning PID Control of Cruise Missiles
Conventional fixed-gain PID controllers face inherent limitations in maintaining optimal performance across the diverse and dynamic flight phases of cruise missiles. To overcome these challenges, we propose Time-Fusion Proximal Policy Optimization (TF-PPO), a novel adaptive reinforcement learning framework designed specifically for cruise missile control. TF-PPO synergistically integrates Long Short-Term Memory (LSTM) networks for enhanced temporal state perception and phase-specific reward engineering enabling self-evolution of PID parameters. Extensive hardware-in-the-loop experiments tailored to cruise missile dynamics demonstrate that TF-PPO achieves a 36.3% improvement in control accuracy over conventional PID methods. The proposed framework provides a robust, high-precision adaptive control solution capable of enhancing the performance of cruise missile systems under varying operational.
Authors
- Zhang Bang-chu
- Weiyu Zhu (ORCID: https://orcid.org/0000-0001-6660-2598)
- Jianfeng Wang (ORCID: https://orcid.org/0000-0002-2018-3348)
- Sen Hu (ORCID: https://orcid.org/0000-0002-4201-5919)
- Chang Tan
- Hong Cai
Institutions
- Sun Yat-sen University (CN)
Publication Details
- Journal
- Aerospace
- Published
- 2025-09-20
- DOI
- https://doi.org/10.3390/aerospace12090849
- Primary Topic
- Extremum Seeking Control Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province