A few-shot oil spill segmentation network guided by multi-scale feature similarity modeling

Segmentation of oil spills with few-shot samples using UAV optical and SAR images is crucial for enhancing the efficiency of oil spill monitoring. Current oil spill semantic segmentation predominantly relies on SAR images, rendering it relatively data-dependent. We propose a flexible and scalable few-shot oil spill segmentation network that transitions from UAV optical images to SAR images based on the image similarity of oil spill regions in both types of images. Specifically, we introduce an Adaptive Feature Enhancement Module (AFEM) between the support set branch and the query set branch. This module leverages the precise oil spill information from the UAV optical image support set to derive initial oil spill templates and subsequently refines and updates the query oil spill templates through training to guide the segmentation of SAR oil spills with limited samples. Additionally, to fully exploit information from both low and high-level features, we design a Feature Fusion Module (FFM) to merge these features. Finally, the experimental results demonstrate the effectiveness of our network in enhancing the performance of UAV optical-to-SAR oil spill segmentation with few samples. Notably, the SAR oil spill detection accuracy reaches 75.88% in 5-shot experiments, representing an average improvement of 5.3% over the optimal baseline model accuracy.