SFBDA: A Semantic-Decoupled Data Augmentation Framework for Infrared Few-Shot Object Detection on UAVs

Few-shot object detection (FSOD) is a critical frontier in computer vision research. However, the task of infrared(IR) FSOD presents significant technical challenges, primarily due to (1) few annotated training samples and (2) the low-texture nature of thermal imaging. To address these issues, we propose a Semantic-guided Foreground-Background Decoupling Augmentation (SFBDA) framework. This method includes an instance-level foreground separation module that utilizes SAM to separate the objects, as well as a semantic-constrained background generation network that employs adversarial learning to synthesize contextually compatible backgrounds. To address the insufficiency of scenario diversity in existing (unmanned aerial vehicle)UAV-based IR object detection datasets, we introduce MSIR-UAVDET, a novel multi-scene IR UAV detection benchmark. This dataset encompasses 16 object categories across diverse environments (terrestrial, maritime, aerial). To validate the efficacy of the proposed data augmentation methodology, we integrated our approach with existing few-shot object detection frameworks and comparative experiments were conducted to benchmark our method with existing data augmentation methods. The code and dataset can be publicly available at: https://github.com/Sea814/SFBDA.git.