Improved Transformer Network Based on Multiscale Grouping Feature Fusion for Hyperspectral Image Classification
In recent years, hyperspectral image classification methods based on convolutional neural networks and Transformer architectures have achieved remarkable success. However, existing Transformer-based models exhibit several limitations, including insufficient capability in modeling local spectral structures, difficulty in capturing complex correlations between nonadjacent spectral bands, and excessive model parameter counts, which hinder their deployment in resource-constrained environments. To address these issues, this article proposes a novel model, multiscale grouped feature fusion vision transformer (MGFF-ViT), designed to enhance spectral feature representation while maintaining parameter efficiency. First, we introduce a new spectral aggregation module, spectral odd–even fusion, which reshapes spectral vectors into highly correlated spectral matrices. This allows the model to extract both local spectral features and long-range dependencies across frequency bands. Second, we propose a multiscale grouped weight attention mechanism that captures spatial contextual information at multiple scales. By applying a sorting-based strategy—“strong to strong, weak to weak”—the module strengthens relevant feature interactions while suppressing noise and redundancy. In addition to improving classification accuracy, MGFF-ViT significantly reduces the number of model parameters, making it lightweight and efficient for practical applications. Extensive experiments on four publicly available hyperspectral datasets demonstrate that MGFF-ViT achieves competitive or superior performance compared to state-of-the-art methods, even with limited training data.
Authors
- J. Gu (ORCID: https://orcid.org/0000-0001-6252-1758)
- Yuhang Liu (ORCID: https://orcid.org/0000-0002-5246-1330)
- Yuping Yin (ORCID: https://orcid.org/0000-0002-7908-9866)
- Lin Wei (ORCID: https://orcid.org/0009-0004-6799-2507)
- E Yanning
Institutions
- Liaoning Technical University (CN)
- Institute of Software (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3596917
- Citations
- 1
- Primary Topic
- Remote Sensing and Land Use
- Type
- article
- Field-Weighted Citation Impact
- 1.30