Multiscale Graph Transformer Network With Dynamic Superpixel Pyramid for Hyperspectral Image Classification
Hyperspectral image (HSI) classification plays a crucial role in remote sensing applications, leveraging the rich spectral and spatial information inherent in HSI. However, the diverse feature scales of ground objects pose challenges for traditional methods, which often employ fixed-scale feature extraction and struggle to adapt dynamically to varying spatial structures. Moreover, conventional approaches typically emphasize either local spectral or spatial features while neglecting global contextual relationships. To address these limitations, we propose a multi-scale graph Transformer network (MSGTN), which captures spatial features at different scales through multi-scale graph convolutional networks with adaptive graph structures. First, we employ differentiable superpixel segmentation to construct flexible graph topologies in the feature space, enabling adaptive representation learning at various spatial scales. Second, a multi-scale graph convolutional network (GCN) is introduced to jointly model spectral and spatial features, enhancing the network's capacity to represent local structural information. Finally, a spectral–spatial Transformer module is integrated to model complex global dependencies among superpixels, capturing long-range contextual relationships. Extensive experiments conducted on four widely used hyperspectral datasets, University of Pavia (UP), Indian Pines (IP), Salinas Valley (SA), and WHU-Hi-HongHu (WHHH), demonstrate the effectiveness of the proposed MSGTN. The model achieves classification accuracies of 99.01% (UP), 96.94% (IP), 99.43% (SA), and 97.95% (WHHH) using only 1%, 5%, 1%, and 1% of labeled training samples, respectively. Compared with state-of-the-art methods, MSGTN exhibits superior classification performance and enhanced robustness across varying data conditions. The code of this work is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/w-tingting/MSGTN</uri>.
Authors
- Tingting Wang (ORCID: https://orcid.org/0000-0002-7605-4860)
- Yao Sun (ORCID: https://orcid.org/0000-0002-4924-7624)
- Yunfeng Hu (ORCID: https://orcid.org/0000-0003-4068-0664)
Institutions
- Jilin University (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3570267
- Citations
- 1
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 1.14