Phase-Adaptive Reinforcement Learning for Self-Tuning PID Control of Cruise Missiles

Conventional fixed-gain PID controllers face inherent limitations in maintaining optimal performance across the diverse and dynamic flight phases of cruise missiles. To overcome these challenges, we propose Time-Fusion Proximal Policy Optimization (TF-PPO), a novel adaptive reinforcement learning framework designed specifically for cruise missile control. TF-PPO synergistically integrates Long Short-Term Memory (LSTM) networks for enhanced temporal state perception and phase-specific reward engineering enabling self-evolution of PID parameters. Extensive hardware-in-the-loop experiments tailored to cruise missile dynamics demonstrate that TF-PPO achieves a 36.3% improvement in control accuracy over conventional PID methods. The proposed framework provides a robust, high-precision adaptive control solution capable of enhancing the performance of cruise missile systems under varying operational.

Authors

Institutions

Publication Details

Journal
Aerospace
Published
2025-09-20
DOI
https://doi.org/10.3390/aerospace12090849
Primary Topic
Extremum Seeking Control Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Phase-Adaptive Reinforcement Learning for Self-Tuning PID Control of Cruise Missiles

Zhang Bang-chu, Weiyu Zhu, Jianfeng Wang, Sen Hu et al.
Aerospace
Extremum Seeking Control Systems
article

Phase-Adaptive Reinforcement Learning for Self-Tuning PID Control of Cruise Missiles

Zhang Bang-chu, Weiyu Zhu, Jianfeng Wang, Sen Hu, Chang Tan, Hong Cai
article en

Abstract

Conventional fixed-gain PID controllers face inherent limitations in maintaining optimal performance across the diverse and dynamic flight phases of cruise missiles. To overcome these challenges, we propose Time-Fusion Proximal Policy Optimization (TF-PPO), a novel adaptive reinforcement learning framework designed specifically for cruise missile control. TF-PPO synergistically integrates Long Short-Term Memory (LSTM) networks for enhanced temporal state perception and phase-specific reward engineering enabling self-evolution of PID parameters. Extensive hardware-in-the-loop experiments tailored to cruise missile dynamics demonstrate that TF-PPO achieves a 36.3% improvement in control accuracy over conventional PID methods. The proposed framework provides a robust, high-precision adaptive control solution capable of enhancing the performance of cruise missile systems under varying operational.

AerospaceVol. 12(9)
Sun Yat-sen University (CN)
National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province
Openalex Percentile: Top 68%
Extremum Seeking Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.