Wavelet-Based Multi-Stream Spatial-Frequency Fusion Network for Few-Shot Hyperspectral Image Classification

In the research of hyperspectral image classification, deep learning-based methods have achieved promising results. However, due to the high cost and difficulty in obtaining labeled hyperspectral image samples, traditional deep learning methods experience a significant performance decline under few-shot conditions. This paper proposes a deep few-shot learning method, referred to as Wavelet-Based Multi-stream Spatial-Frequency Fusion Network, to address the issue of small sample size in hyperspectral image classification. Through a multi-stream structure, features at various scales are obtained, effectively alleviating the issue of insufficient feature representation caused by limited training samples. These features are then fed into a multi-level wavelet transformation module integrated with a frequency-domain attention module. By decomposing the input into high-frequency and low-frequency components via wavelet transformation, and subsequently inputting these components into the frequency-domain attention module, a richer representation of features in the frequency domain is achieved. Finally, a Spatial-Frequency Fusion module is employed to not only extract abundant feature information but also fuse features from different scales. This process results in feature maps that encompass more comprehensive global feature information, thereby significantly enhancing classification accuracy under small sample conditions. The proposed method has been compared with traditional machine learning approaches and recent deep learning methods on the Houston, Dioni, and University of Pavia datasets. Under training conditions using only 1 to 5, 10, 15, and 20 samples per class, the experimental results demonstrate the superiority of the method proposed in this paper.