Research on Intelligent Penetration Technology of High Speed Flight Vehicle Based on PPO Algorithm

In this paper, a high speed flight vehicle intelligent control method based on the proximal policy optimization (PPO) algorithm is researched. This method can be used to avoid the impact of interceptor employing the pure proportional navigation (PPN) guidance strategy in three dimensions. First, the interception process of the interceptor and the penetration process of the flight vehicle in the actual scenario were analyzed. The flight vehicle kinematic model, the interceptor kinematic model based on the PPN guidance law, and the relative motion model were constructed. Then, a flight vehicle intelligent penetration guidance law training model was built with specific scenarios. PPO-based model structure, state space, action space, reward function and training end conditions were designed. Finally, an intelligent flight vehicle penetration control model is formed through training, and the effectiveness of the proposed penetration method is verified through simulation tests. The method is applied to penetrate other performance interceptors and compared with other maneuvering strategies. The results verify the robustness and significant advantages of the intelligent penetration method. The intelligent penetration method studied in this paper has certain reference value for the flight vehicle guidance law design.