SAM-Based Efficient Feature Integration Network for Remote Sensing Change Detection: A Case Study on Macao Sea Reclamation
Sea reclamation expands land resources along coastal areas and supports sustainable urban growth. Sea reclamation monitoring is a significant application of remote sensing change detection (RSCD). Segment Anything Model (SAM) supports zero-shot image segmentation, but lacks general features of remote sensing images (RSIs), making it difficult to directly apply to RSCD. To utilize the visual recognition capabilities of SAM for improving RSCD, we propose an SAM-based Efficient Feature Integration Network (EFI-SAM). Random Fourier Features Adaptor (RFFA) is utilized to enhance Mobile SAM's capability for extracting general features from complex RSIs, resulting in Adaptive Mobile SAM, which serves as the feature extractor of EFI-SAM. To effectively integrate remote sensing difference features, Long-range Spatial Features Integration Module (LSFI) is designed to fuse the long-range spatial correlation of bi-temporal semantic features. Cross-dimensional Contextual Information Aggregation Decoder (CCIA) is then designed to effectively aggregate the multi-dimensional change information. Furthermore, we collected Macao RSIs through GEE to create a dataset, named Macao Land Change Detection (MLCD) dataset, which contains 10,000 images of size <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$256 \times 256$</tex-math></inline-formula> . Experiments indicate that EFI-SAM achieves the highest metrics, with F1 of 80.75%, 75.86%, 82.86%, and 64.74% in MLCD, CLCD, SYSU-CD, and S2Looking, respectively. In addition to its high accuracy, it is noteworthy that EFI-SAM is a lightweight network with only 5.83M parameter. The code will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/juncyan/efi-sam.git</uri>.
Authors
- Min Xia (ORCID: https://orcid.org/0000-0003-4681-9129)
- Xiaochen Yuan (ORCID: https://orcid.org/0000-0002-7490-6695)
- Junqi Bao (ORCID: https://orcid.org/0000-0003-1879-5780)
- Junqing Huang (ORCID: https://orcid.org/0009-0000-4425-1168)
Institutions
- Nanjing University of Information Science and Technology (CN)
- Macao Polytechnic University (MO)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3584145
- Citations
- 4
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 4.54