EnergyFormer: Energy Attention With Fourier Embedding for Hyperspectral Image Classification
Hyperspectral images (HSIs) capture detailed spectral–spatial information across hundreds of contiguous bands, enabling precise material identification in domains such as environmental monitoring, agriculture, and urban analysis. However, the high dimensionality and spectral variability inherent to HSIs present significant challenges for effective feature extraction and classification. This letter introduces EnergyFormer (EF), a transformer-based framework designed to overcome these limitations through three key innovations: 1) multihead energy attention (MHEA), which formulates an energy optimization mechanism to selectively enhance discriminative spectral–spatial features; 2) Fourier positional embedding (FoPE), which adaptively models long-range spectral and spatial dependencies; and 3) enhanced convolutional block attention module (ECBAM), which emphasizes informative wavelength bands and spatial structures for robust representation learning. Extensive experiments on the WHU-Hi-HanChuan, Salinas, and Pavia University datasets demonstrate that EF achieves superior classification performance with overall accuracies of 99.28%, 98.63%, and 98.72%, respectively, outperforming leading CNN-, transformer-, and Mamba-based models.
Authors
- Usman Ghous (ORCID: https://orcid.org/0000-0003-0673-6062)
- Salvatore Distefano (ORCID: https://orcid.org/0000-0002-2752-626X)
- Muhammad Ahmad (ORCID: https://orcid.org/0000-0002-3320-2261)
- Manuel Mazzara (ORCID: https://orcid.org/0000-0002-3860-4948)
- Muhammad Usama (ORCID: https://orcid.org/0000-0001-5015-8605)
- Shahla Sohail
Institutions
- University of Messina (IT)
- King Fahd University of Petroleum and Minerals (SA)
- National University of Computer and Emerging Sciences (PK)
- Innopolis University (RU)
Publication Details
- Journal
- IEEE Geoscience and Remote Sensing Letters
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/lgrs.2025.3596629
- Citations
- 1
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 2.48