Efficient CNN-Transformer Aggregation Network for Remote Sensing Image Change Detection
Change detection is a crucial task in the field of remote sensing, focusing on identifying areas where significant changes occur between two remote sensing images captured at different time points. However, existing change detection methods based on CNNs or Transformers face two main challenges. Firstly, CNNs often lack the ability to effectively model long-range dependencies, resulting in diminished recognition performance for targets sharing the same semantics but having different features. Secondly, Transformers leverage self-attention mechanisms to capture long-range dependencies adeptly but struggle to capture local details and multi-scale features effectively. In response to these challenges, we propose a CNN and Transformer Aggregation Network (CTA-Net) for change detection in remote sensing images. Specifically, we devise two encoders based on Transformers and CNNs, respectively, facilitating the generation of complementary global and local features during the encoding phase. In the decoding phase, we design a pyramid-structured complementary decoder to aggregate multi-level complementary features from the CNN and Transformer branches. Furthermore, we propose a novel skip connection strategy to exploit the relationship between decoded features and multi-level complementary features, thereby enhancing the model's multi-scale invariance. Extensive experiments conducted on multiple benchmark datasets validate the effectiveness of our proposed CTA-Net model.
Authors
- Qinglong Meng (ORCID: https://orcid.org/0000-0003-0645-1032)
- Jinqiang Bai (ORCID: https://orcid.org/0000-0003-4322-6598)
- Beibei Kong (ORCID: https://orcid.org/0000-0001-8739-0301)
- Fengqi Hao (ORCID: https://orcid.org/0009-0002-3458-6567)
Institutions
- Qilu University of Technology (CN)
- Shandong Academy of Sciences (CN)
Publication Details
- Published
- 2024-10-06
- DOI
- https://doi.org/10.1109/smc54092.2024.10831667
- Citations
- 1
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.32
Funders
- National Natural Science Foundation of China
- Qilu University of Technology
- National Natural Science Foundation of China-Shandong Joint Fund