Incremental Classification of Cross-Scene Hyperspectral Images Based on Dual Constraints and Knowledge Transfer

With the rapid advancement of hyperspectral imaging technology, there has been a dramatic surge in the volume of hyperspectral data, presenting unprecedented challenges for the incremental classification of hyperspectral images (HSI). In cross-scene HSI incremental classification, two critical challenges emerge: (1) the effectiveness of traditional sample replay methods is limited by high-dimensional data storage and privacy protection constraints; and (2) diverse scenes lead to catastrophic forgetting during new task learning. To address these challenges, this paper proposes an Incremental Classification algorithm based on Dual Constraints and Knowledge Transfer (IC-DCKT) for cross-scene hyperspectral images. First, to overcome the limitations of traditional replay methods in data storage and privacy protection, IC-DCKT innovatively introduces a sample-free storage approach. By combining regularization with knowledge distillation techniques, it achieves efficient knowledge transfer and retention. Second, to effectively mitigate catastrophic forgetting, the algorithm implements a dual-constraint mechanism: the approximate Null Space Projection Constraint (NSPC) restricts gradient update directions to preserve historical task feature distributions, while the Cosine Similarity Distillation Constraint (CSDC) enforces feature alignment between old and new models, significantly enhancing the model’s ability to retain knowledge of old tasks. Finally, this paper pioneers the integration of the pretrained hyperspectral large model HyperSIGMA into an incremental learning framework. The Feature Alignment Loss (FAL) not only improves the speed of new task learning but also compensates for the loss of critical information in new tasks caused by gradient update direction constraints imposed by NSPC. Experimental results on three hyperspectral datasets demonstrate that the proposed IC-DCKT method outperforms existing state-of-the-art incremental learning approaches.

Authors

Institutions

Publication Details

Journal
IEEE Geoscience and Remote Sensing Letters
Published
2025-01-01
DOI
https://doi.org/10.1109/lgrs.2025.3569506
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Incremental Classification of Cross-Scene Hyperspectral Images Based on Dual Constraints and Knowledge Transfer

Jiaxu Guo, Zhaokui Li, Ke Wang, Yan Wang
IEEE Geoscience and Remote Sensing Letters
Remote-Sensing Image Classification
article

Incremental Classification of Cross-Scene Hyperspectral Images Based on Dual Constraints and Knowledge Transfer

Jiaxu Guo, Zhaokui Li, Ke Wang, Yan Wang
article en

Abstract

With the rapid advancement of hyperspectral imaging technology, there has been a dramatic surge in the volume of hyperspectral data, presenting unprecedented challenges for the incremental classification of hyperspectral images (HSI). In cross-scene HSI incremental classification, two critical challenges emerge: (1) the effectiveness of traditional sample replay methods is limited by high-dimensional data storage and privacy protection constraints; and (2) diverse scenes lead to catastrophic forgetting during new task learning. To address these challenges, this paper proposes an Incremental Classification algorithm based on Dual Constraints and Knowledge Transfer (IC-DCKT) for cross-scene hyperspectral images. First, to overcome the limitations of traditional replay methods in data storage and privacy protection, IC-DCKT innovatively introduces a sample-free storage approach. By combining regularization with knowledge distillation techniques, it achieves efficient knowledge transfer and retention. Second, to effectively mitigate catastrophic forgetting, the algorithm implements a dual-constraint mechanism: the approximate Null Space Projection Constraint (NSPC) restricts gradient update directions to preserve historical task feature distributions, while the Cosine Similarity Distillation Constraint (CSDC) enforces feature alignment between old and new models, significantly enhancing the model’s ability to retain knowledge of old tasks. Finally, this paper pioneers the integration of the pretrained hyperspectral large model HyperSIGMA into an incremental learning framework. The Feature Alignment Loss (FAL) not only improves the speed of new task learning but also compensates for the loss of critical information in new tasks caused by gradient update direction constraints imposed by NSPC. Experimental results on three hyperspectral datasets demonstrate that the proposed IC-DCKT method outperforms existing state-of-the-art incremental learning approaches.

IEEE Geoscience and Remote Sensing LettersVol. 22
Shenyang Aerospace University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 86%
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.