EnergyFormer: Energy Attention With Fourier Embedding for Hyperspectral Image Classification

Hyperspectral images (HSIs) capture detailed spectral–spatial information across hundreds of contiguous bands, enabling precise material identification in domains such as environmental monitoring, agriculture, and urban analysis. However, the high dimensionality and spectral variability inherent to HSIs present significant challenges for effective feature extraction and classification. This letter introduces EnergyFormer (EF), a transformer-based framework designed to overcome these limitations through three key innovations: 1) multihead energy attention (MHEA), which formulates an energy optimization mechanism to selectively enhance discriminative spectral–spatial features; 2) Fourier positional embedding (FoPE), which adaptively models long-range spectral and spatial dependencies; and 3) enhanced convolutional block attention module (ECBAM), which emphasizes informative wavelength bands and spatial structures for robust representation learning. Extensive experiments on the WHU-Hi-HanChuan, Salinas, and Pavia University datasets demonstrate that EF achieves superior classification performance with overall accuracies of 99.28%, 98.63%, and 98.72%, respectively, outperforming leading CNN-, transformer-, and Mamba-based models.

Authors

Institutions

Publication Details

Journal
IEEE Geoscience and Remote Sensing Letters
Published
2025-01-01
DOI
https://doi.org/10.1109/lgrs.2025.3596629
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EnergyFormer: Energy Attention With Fourier Embedding for Hyperspectral Image Classification

Usman Ghous, Salvatore Distefano, Muhammad Ahmad, Manuel Mazzara et al.
1 citations
IEEE Geoscience and Remote Sensing Letters
Neural Networks and Applications
2.48
article

EnergyFormer: Energy Attention With Fourier Embedding for Hyperspectral Image Classification

Usman Ghous, Salvatore Distefano, Muhammad Ahmad, Manuel Mazzara, Muhammad Usama, Shahla Sohail
article en
1 citations

Abstract

Hyperspectral images (HSIs) capture detailed spectral–spatial information across hundreds of contiguous bands, enabling precise material identification in domains such as environmental monitoring, agriculture, and urban analysis. However, the high dimensionality and spectral variability inherent to HSIs present significant challenges for effective feature extraction and classification. This letter introduces EnergyFormer (EF), a transformer-based framework designed to overcome these limitations through three key innovations: 1) multihead energy attention (MHEA), which formulates an energy optimization mechanism to selectively enhance discriminative spectral–spatial features; 2) Fourier positional embedding (FoPE), which adaptively models long-range spectral and spatial dependencies; and 3) enhanced convolutional block attention module (ECBAM), which emphasizes informative wavelength bands and spatial structures for robust representation learning. Extensive experiments on the WHU-Hi-HanChuan, Salinas, and Pavia University datasets demonstrate that EF achieves superior classification performance with overall accuracies of 99.28%, 98.63%, and 98.72%, respectively, outperforming leading CNN-, transformer-, and Mamba-based models.

IEEE Geoscience and Remote Sensing LettersVol. 22
University of Messina (IT), King Fahd University of Petroleum and Minerals (SA), National University of Computer and Emerging Sciences (PK), Innopolis University (RU)
Affordable and clean energy
Openalex Percentile: Top 9%
Neural Networks and Applications
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.