Robustness Evaluation of Hyperspectral Image Classification Models Using Degradation-Aware Metrics

Hyperspectral image classification studies are generally evaluated on clean benchmark datasets and often report high-accuracy values. However, because real sensor data can be affected by different degradations, such as Gaussian, impulse, stripe, dead-line, and mixed noise, clean-data performance alone may be insufficient to explain the reliability of models under practical conditions. In this study, SVM, k-NN, 1D-CNN, 2D-CNN, 3D-CNN, Hybrid CNN, Dense CNN, and a transformer-based model were evaluated on the Indian Pines, Pavia University, and Salinas datasets under controlled noise scenarios. The overall accuracy (OA), average accuracy (AA), kappa coefficient, and macro-F1 score were used as standard performance metrics. In addition, two robustness-oriented metrics, Relative Degradation Rate (RDR) and Robustness Score (RS), were used to measure noise-induced performance degradation more explicitly. The findings show that model rankings obtained on clean data may change under noisy conditions depending on the dataset and noise type. Performance degradation was more evident for some models, especially under mixed-severity and high-severity noise scenarios. Overall, the results indicate that hyperspectral classification models should be evaluated not only based on clean-data accuracy but also in terms of their robustness against different types of sensor noise.

Authors

Institutions

Publication Details

Journal
Black Sea Journal of Engineering and Science
Published
2026-09-14
DOI
https://doi.org/10.34248/bsengineering.1991363
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Robustness Evaluation of Hyperspectral Image Classification Models Using Degradation-Aware Metrics

Cem Atılgan
Black Sea Journal of Engineering and Science
Remote-Sensing Image Classification
article

Robustness Evaluation of Hyperspectral Image Classification Models Using Degradation-Aware Metrics

Cem Atılgan
article en

Abstract

Hyperspectral image classification studies are generally evaluated on clean benchmark datasets and often report high-accuracy values. However, because real sensor data can be affected by different degradations, such as Gaussian, impulse, stripe, dead-line, and mixed noise, clean-data performance alone may be insufficient to explain the reliability of models under practical conditions. In this study, SVM, k-NN, 1D-CNN, 2D-CNN, 3D-CNN, Hybrid CNN, Dense CNN, and a transformer-based model were evaluated on the Indian Pines, Pavia University, and Salinas datasets under controlled noise scenarios. The overall accuracy (OA), average accuracy (AA), kappa coefficient, and macro-F1 score were used as standard performance metrics. In addition, two robustness-oriented metrics, Relative Degradation Rate (RDR) and Robustness Score (RS), were used to measure noise-induced performance degradation more explicitly. The findings show that model rankings obtained on clean data may change under noisy conditions depending on the dataset and noise type. Performance degradation was more evident for some models, especially under mixed-severity and high-severity noise scenarios. Overall, the results indicate that hyperspectral classification models should be evaluated not only based on clean-data accuracy but also in terms of their robustness against different types of sensor noise.

Black Sea Journal of Engineering and ScienceVol. 9(5)
Kırklareli University (TR)
Openalex Percentile: Top 13%
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Robustness Evaluation of Hyperspectral Image Classification Models Using Degradation-Aware Metrics — Cem Atılgan · Black Sea Journal of Engineering and Science (2026) | TGRS Research Map | TGRS