Lightweight Masked Spectral Spatial Self Supervised Learning for Few Shot Hyperspectral Image Classification

Hyperspectral image (HSI) classification benefits from hundreds of contiguous spectral bands, yet reliable pixel-level annotations remain costly and scarce. Self-supervised learning (SSL) is able to decrease label dependency, although the most recent models of HSI are based on computationally intensive Transformers, graph-based, multi-branch, or contrastive networks, and might not actively optimize spatial differentiation. This paper proposes Masked SpectralSpatial Self-Supervised Learning (MSS-SSL), which is a relatively simple framework that simultaneously handles spectral recovery, spatial discrimination, few-shot label efficiency, and computational efficiency. MSS-SSL collaboratively undergoes masked spectral-band reconstruction, spatial patch contrastive representation learning and lightweight spectral-spatial encoding. A 128-dimensional representation is generated using a depthwise-separable spectral stem and three depthwise-separable spatial residual blocks that do not use a large Transformer backbone. In pretraining, spectral groups that are adjacent to each other are masked and solved using unlabeled patches, with two spatially semantics-invariant views matched to an InfoNCE loss. The trained encoder is then refined using 1, 3, 5, and 10 pixels that are labeled by the classes. The experimental routine includes Indian Pines, Pavia University, Salinas, and Houston 2013 and tests the total, mean, and Cohen kappa, macro-F1, trainable, FLOPs, inference latency, throughput and label efficiency. Matched masked and contrastive and joint-objective ablations are worked with identical encoder capacity, so that the effects of objectives of objective nature can be disentangled with architectural capacity. The number of repeated seeds is five, to provide statistical stability. This resulting design has a controlled basis of testing the hypothesis of whether complementary reconstruction and discrimination goals may act to exploit the accuracy-to-computation ratio when label abundance becomes extreme; numerical performance assertions would only be made intentionally when the experiments were finished.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-18
DOI
https://doi.org/10.21203/rs.3.rs-11541843/v1
Primary Topic
Remote-Sensing Image Classification
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Lightweight Masked Spectral Spatial Self Supervised Learning for Few Shot Hyperspectral Image Classification

Shuyuan Yang, Fahad Atta, Irzum Shafique, Mubeen Ashraf et al.
1 links
Research Square
Remote-Sensing Image Classification
preprint

Lightweight Masked Spectral Spatial Self Supervised Learning for Few Shot Hyperspectral Image Classification

Shuyuan Yang, Fahad Atta, Irzum Shafique, Mubeen Ashraf, Zamid Mustefa
preprint en

Abstract

Hyperspectral image (HSI) classification benefits from hundreds of contiguous spectral bands, yet reliable pixel-level annotations remain costly and scarce. Self-supervised learning (SSL) is able to decrease label dependency, although the most recent models of HSI are based on computationally intensive Transformers, graph-based, multi-branch, or contrastive networks, and might not actively optimize spatial differentiation. This paper proposes Masked SpectralSpatial Self-Supervised Learning (MSS-SSL), which is a relatively simple framework that simultaneously handles spectral recovery, spatial discrimination, few-shot label efficiency, and computational efficiency. MSS-SSL collaboratively undergoes masked spectral-band reconstruction, spatial patch contrastive representation learning and lightweight spectral-spatial encoding. A 128-dimensional representation is generated using a depthwise-separable spectral stem and three depthwise-separable spatial residual blocks that do not use a large Transformer backbone. In pretraining, spectral groups that are adjacent to each other are masked and solved using unlabeled patches, with two spatially semantics-invariant views matched to an InfoNCE loss. The trained encoder is then refined using 1, 3, 5, and 10 pixels that are labeled by the classes. The experimental routine includes Indian Pines, Pavia University, Salinas, and Houston 2013 and tests the total, mean, and Cohen kappa, macro-F1, trainable, FLOPs, inference latency, throughput and label efficiency. Matched masked and contrastive and joint-objective ablations are worked with identical encoder capacity, so that the effects of objectives of objective nature can be disentangled with architectural capacity. The number of repeated seeds is five, to provide statistical stability. This resulting design has a controlled basis of testing the hypothesis of whether complementary reconstruction and discrimination goals may act to exploit the accuracy-to-computation ratio when label abundance becomes extreme; numerical performance assertions would only be made intentionally when the experiments were finished.

Research Square
Xidian University (CN)
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon