STMNet: Single-Temporal Mask-Based Network for Self-Supervised Hyperspectral Change Detection
Multitemporal hyperspectral images (HSIs) have been widely applied in change detection (CD) of different land covers for their rich spectral features and image details. However, alignment and labeling pairs of bitemporal HSIs are labor-intensive. In this article, we propose a single-temporal mask-based network (STMNet) for self-supervised HSI CD from a new perspective of detecting masks as changes. STMNet implements self-supervised by treating artificially constructed masks attached to single-temporal HSI as changed regions. To this end, we design a multiscale mask change simulation (MMCS) strategy to generate pseudo-second-temporal HSI closer to the real case. Meanwhile, a global-local feature aggregation network is proposed to enhance long-distance and local spatial-spectral feature extraction. To the best of our knowledge, this is the first work in the field of HSI CD that uses single-temporal HSIs and eliminates the need for labeling and pairing samples, alleviating the problem of difficult multitemporal HSI annotation. The visual and quantitative experimental results on three HSI datasets show that the proposed STMNet outperforms the compared state-of-the-art methods for HSI CD. Codes are available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Zhoutya/ChangeDetection-STMNet</uri>.
Authors
- Tan Guo (ORCID: https://orcid.org/0000-0001-9523-8094)
- Chuan Fu (ORCID: https://orcid.org/0000-0002-4031-8086)
- Bo Du (ORCID: https://orcid.org/0000-0002-0059-8458)
- Fulin Luo (ORCID: https://orcid.org/0000-0002-7696-0775)
- Tianpeng Zhou
- Xiaopan Wang
- Xinbo Gao (ORCID: https://orcid.org/0000-0003-1443-0776)
Institutions
- Chongqing University of Posts and Telecommunications (CN)
- Chongqing University (CN)
- Wuhan University (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2024-12-30
- DOI
- https://doi.org/10.1109/tgrs.2024.3523541
- Citations
- 12
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 3.84
Funders
- National Natural Science Foundation of China