Transformer Self-Attention Change Detection Network with Frozen Parameters

The purpose of change detection is to recognize changed areas from a pair of two remote sensing images. However, since change areas often include multiple terrain features, this demands enhanced feature extraction capability from the model. This paper proposes a frozen-parameter Transformer self-attention change detection network (ZAQNet). The network integrates four innovative modules: a GIAU (Generalized Image Attention Unit) which can effectively fuse the features of two remote sensing images and accurately focus on changing areas; a GSAU (Global Spatial Attention Unit) which performs self attention processing in the image spatial dimension to enhance the model’s ability to capture global change information; a GSCU (Global Semantic Context Unit) which performs self-attention operations in the channel dimension to enhance the model’s attention to feature maps containing changing information; and a PRU (Patch Refinement Unit) which extracts and refines spatial position information from the underlying feature map, optimizing the restoration effect of the feature map. The experiments on the BTRS-CD and LEVIR-CD datasets show that ZAQNet performs excellently in change detection tasks. Among them, the change detection index F1 and IOU are better than the comparison model. These results fully demonstrate the superiority, robustness, and generalization ability of ZAQNet in change detection tasks and provide an efficient and reliable solution for remote sensing image analysis.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2025-03-19
DOI
https://doi.org/10.3390/app15063349
Citations
12
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
29.77

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformer Self-Attention Change Detection Network with Frozen Parameters

Min Xia, Haifeng Lin, Zikai Zhao, Dehao Wang et al.
12 citations
Applied Sciences
Neural Networks and Applications
29.77
article

Transformer Self-Attention Change Detection Network with Frozen Parameters

Min Xia, Haifeng Lin, Zikai Zhao, Dehao Wang, Peiyang Cheng
article en
12 citations

Abstract

The purpose of change detection is to recognize changed areas from a pair of two remote sensing images. However, since change areas often include multiple terrain features, this demands enhanced feature extraction capability from the model. This paper proposes a frozen-parameter Transformer self-attention change detection network (ZAQNet). The network integrates four innovative modules: a GIAU (Generalized Image Attention Unit) which can effectively fuse the features of two remote sensing images and accurately focus on changing areas; a GSAU (Global Spatial Attention Unit) which performs self attention processing in the image spatial dimension to enhance the model’s ability to capture global change information; a GSCU (Global Semantic Context Unit) which performs self-attention operations in the channel dimension to enhance the model’s attention to feature maps containing changing information; and a PRU (Patch Refinement Unit) which extracts and refines spatial position information from the underlying feature map, optimizing the restoration effect of the feature map. The experiments on the BTRS-CD and LEVIR-CD datasets show that ZAQNet performs excellently in change detection tasks. Among them, the change detection index F1 and IOU are better than the comparison model. These results fully demonstrate the superiority, robustness, and generalization ability of ZAQNet in change detection tasks and provide an efficient and reliable solution for remote sensing image analysis.

Applied SciencesVol. 15(6)
Nanjing Forestry University (CN), Nanjing University of Information Science and Technology (CN), University of Reading (GB)
National Natural Science Foundation of China
Openalex Percentile: Top 0%
Neural Networks and Applications
29.77
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.