VISIONARY: Novel Spatial-Spectral Attention Mechanism for Hyperspectral Image Denoising

Image denoising mitigates noise from the captured images and thereby, enhances the efficacy of high-demand vision applications, such as classification and segmentation. Hyperspectral Images (HSIs), with their multiple spectral bands, provide valuable information and make them highly applicable in real-world applications. Current Deep Learning methods mainly employ Transformers to denoise HSIs spatially and spectrally through self-attention (SA). However, SA focuses on individual samples and overlooks potential correlations within the images, indicating room for improvement. Moreover, existing Transformer-based denoising methods often fail to appropriately balance the importance of spatial and spectral features. This paper presents a novel method, VISIONARY, to address these issues by obtaining better HSI feature representation. To this end, it introduces the Spatial-Spectral-Cubic Transformer (SS-Cformer) block to address the shortcomings of Transformers in HSI denoising, particularly their inability to capture correlations within images of the same type, by introducing Global Feature Attention (GFA). Additionally, the SSC-former independently determines the optimal weightage for spatial and spectral features using attention mechanisms, leading to more effective denoising. Our method, VISIONARY is based on the integration of Transformer, U-Net and CNN architecture. Experimental results demonstrate that VISIONARY outperforms well-known methods on publicly available datasets, and our SSCformer block can be easily integrated with existing Transformer-based HSI denoising methods to improve their efficacy.

Authors

Institutions

Publication Details

Published
2025-02-26
DOI
https://doi.org/10.1109/wacv61041.2025.00271
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

VISIONARY: Novel Spatial-Spectral Attention Mechanism for Hyperspectral Image Denoising

Ankur Garg, Puneet Gupta, Aditya Dixit, Nischit Hosamani
3 links
Remote-Sensing Image Classification
article

VISIONARY: Novel Spatial-Spectral Attention Mechanism for Hyperspectral Image Denoising

Ankur Garg, Puneet Gupta, Aditya Dixit, Nischit Hosamani
article en

Abstract

Image denoising mitigates noise from the captured images and thereby, enhances the efficacy of high-demand vision applications, such as classification and segmentation. Hyperspectral Images (HSIs), with their multiple spectral bands, provide valuable information and make them highly applicable in real-world applications. Current Deep Learning methods mainly employ Transformers to denoise HSIs spatially and spectrally through self-attention (SA). However, SA focuses on individual samples and overlooks potential correlations within the images, indicating room for improvement. Moreover, existing Transformer-based denoising methods often fail to appropriately balance the importance of spatial and spectral features. This paper presents a novel method, VISIONARY, to address these issues by obtaining better HSI feature representation. To this end, it introduces the Spatial-Spectral-Cubic Transformer (SS-Cformer) block to address the shortcomings of Transformers in HSI denoising, particularly their inability to capture correlations within images of the same type, by introducing Global Feature Attention (GFA). Additionally, the SSC-former independently determines the optimal weightage for spatial and spectral features using attention mechanisms, leading to more effective denoising. Our method, VISIONARY is based on the integration of Transformer, U-Net and CNN architecture. Experimental results demonstrate that VISIONARY outperforms well-known methods on publicly available datasets, and our SSCformer block can be easily integrated with existing Transformer-based HSI denoising methods to improve their efficacy.

Indian Institute of Technology Indore (IN)
Climate action
Openalex Percentile: Top 90%
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.