Remote sensing few-shot object detection using adaptive feature modification and Gaussian dynamic dilated convolution

Object detection in remote sensing images relies on a large amount of annotated data for training, but adequately annotating novel classes is difficult. Few-Shot Object Detection (FSOD) address this problem by fine-tuning on finitely annotated novel classes, this results in its within-class variation being limited, making it difficult to adequately fit the within-class distribution. In order to alleviate this problem, this paper proposed a few-shot object detection method in remote sensing based on adaptive feature modification and guided by Gaussian dynamic dilated convolution. Firstly, in view of the difficulty of novel classes recognition, an adaptive feature modification algorithm is proposed. By using the characteristics of the two-branch network architecture of meta-learning itself, the support features are integrated into the query feature extraction network as convolutional bias to adaptively modify the query features. Secondly, in order to simulate intra-class variation of noise (feature perturbation caused by noise in the foreground), the backbone network weights were reparameterized to make them fit Gaussian distribution variables during fine-tuning, and the feature perturbation was achieved with parameter variation. Finally, in order to simulate intra-class scale variation (different foreground sizes), the convolution is changed into a dynamic dilation convolution, and different dilation rates are used to replace feature scale variation. Extensive experiments on two widely used remote sensing datasets (NWPU.V2, dior) demonstrate the effectiveness of the proposed method.