DETEAMSK: A Model-Based Reinforcement Learning Approach to Intelligent Top-Level Planning and Decisions for Multi-Drone Ad Hoc Teamwork by Decoupling the Identification of Teammate and Task

The ability to collaborate with new teammates, adapt to unfamiliar environments, and engage in effective planning is essential for multi-drone agents within unmanned combat systems. This paper introduces DETEAMSK (Model-based Reinforcement Learning by Decoupling the Identification of Teammates and Tasks), a model-based reinforcement learning method in intelligent top-level planning and decisions designed for ad hoc teamwork among multi-drone agents. It specifically addresses integrated reconnaissance and strike missions in urban combat scenarios under varying conditions. DETEAMSK’s performance is evaluated through comprehensive, multidimensional experiments and compared with other baseline models. The results demonstrate that DETEAMSK exhibits superior effectiveness, robustness, and generalization capabilities across a range of task domains. Moreover, the model-based reinforcement learning approach offers distinct advantages over traditional models, such as the PLASTIC-Model, and model-free approaches, like the PLASTIC-Policy, due to its unique “dynamic decoupling identification” feature. This study provides valuable insights for advancing both theoretical and applied research in model-based reinforcement learning methods for multi-drone systems.