Multiscale Graph Transformer Network With Dynamic Superpixel Pyramid for Hyperspectral Image Classification

Hyperspectral image (HSI) classification plays a crucial role in remote sensing applications, leveraging the rich spectral and spatial information inherent in HSI. However, the diverse feature scales of ground objects pose challenges for traditional methods, which often employ fixed-scale feature extraction and struggle to adapt dynamically to varying spatial structures. Moreover, conventional approaches typically emphasize either local spectral or spatial features while neglecting global contextual relationships. To address these limitations, we propose a multi-scale graph Transformer network (MSGTN), which captures spatial features at different scales through multi-scale graph convolutional networks with adaptive graph structures. First, we employ differentiable superpixel segmentation to construct flexible graph topologies in the feature space, enabling adaptive representation learning at various spatial scales. Second, a multi-scale graph convolutional network (GCN) is introduced to jointly model spectral and spatial features, enhancing the network's capacity to represent local structural information. Finally, a spectral–spatial Transformer module is integrated to model complex global dependencies among superpixels, capturing long-range contextual relationships. Extensive experiments conducted on four widely used hyperspectral datasets, University of Pavia (UP), Indian Pines (IP), Salinas Valley (SA), and WHU-Hi-HongHu (WHHH), demonstrate the effectiveness of the proposed MSGTN. The model achieves classification accuracies of 99.01% (UP), 96.94% (IP), 99.43% (SA), and 97.95% (WHHH) using only 1%, 5%, 1%, and 1% of labeled training samples, respectively. Compared with state-of-the-art methods, MSGTN exhibits superior classification performance and enhanced robustness across varying data conditions. The code of this work is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/w-tingting/MSGTN</uri>.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/jstars.2025.3570267
Citations
1
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
1.14
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multiscale Graph Transformer Network With Dynamic Superpixel Pyramid for Hyperspectral Image Classification

Tingting Wang, Yao Sun, Yunfeng Hu
1 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Remote-Sensing Image Classification
1.14
article

Multiscale Graph Transformer Network With Dynamic Superpixel Pyramid for Hyperspectral Image Classification

Tingting Wang, Yao Sun, Yunfeng Hu
article en
1 citations

Abstract

Hyperspectral image (HSI) classification plays a crucial role in remote sensing applications, leveraging the rich spectral and spatial information inherent in HSI. However, the diverse feature scales of ground objects pose challenges for traditional methods, which often employ fixed-scale feature extraction and struggle to adapt dynamically to varying spatial structures. Moreover, conventional approaches typically emphasize either local spectral or spatial features while neglecting global contextual relationships. To address these limitations, we propose a multi-scale graph Transformer network (MSGTN), which captures spatial features at different scales through multi-scale graph convolutional networks with adaptive graph structures. First, we employ differentiable superpixel segmentation to construct flexible graph topologies in the feature space, enabling adaptive representation learning at various spatial scales. Second, a multi-scale graph convolutional network (GCN) is introduced to jointly model spectral and spatial features, enhancing the network's capacity to represent local structural information. Finally, a spectral–spatial Transformer module is integrated to model complex global dependencies among superpixels, capturing long-range contextual relationships. Extensive experiments conducted on four widely used hyperspectral datasets, University of Pavia (UP), Indian Pines (IP), Salinas Valley (SA), and WHU-Hi-HongHu (WHHH), demonstrate the effectiveness of the proposed MSGTN. The model achieves classification accuracies of 99.01% (UP), 96.94% (IP), 99.43% (SA), and 97.95% (WHHH) using only 1%, 5%, 1%, and 1% of labeled training samples, respectively. Compared with state-of-the-art methods, MSGTN exhibits superior classification performance and enhanced robustness across varying data conditions. The code of this work is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/w-tingting/MSGTN</uri>.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Jilin University (CN)
Affordable and clean energy
Openalex Percentile: Top 20%
Remote-Sensing Image Classification
1.14
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.