STIFormer: Spatial-Temporal Interactive Transformer for Dual-Phase Remote Sensing Images Semantic Change Detection

The Semantic Change Detection (SCD) in remote sensing images requires accurate extraction of change regions while distinguishing between different types of changes. The temporal span between the two phases is often considerable, resulting in a diverse range of change types across a wide imaging field, with some changes being more apparent than others. Additionally, the scale of change regions can vary from local to global, posing significant challenges for SCD in dual-phase remote sensing images. To address these issues, we propose a semantic change detection method leveraging spatio-temporal dependencies. Firstly, we individually process the dual-phase remote sensing images using an encoder structure with shared weights to extract semantic-level features. These features are then subjected to convolutional operations to generate representations of change regions, enhancing the capability to extract less obvious changes. Subsequently, a transformer structure representing the semantic changes in the dual-phase images is introduced. This structure effectively utilizes the spatio-temporal characteristics of the images to obtain global and change features, addressing the issue of insufficient feature representation for large-scale change regions. Finally, we introduce a semantic learning scheme that utilizes spatio-temporal constraints consistent with the SCD task to guide the learning of semantic changes. The proposed network is evaluated on datasets obtained from high-resolution and resource series satellites, achieving an IOU of 94.49% and an accuracy of 99.04%. These results convincingly demonstrate the effectiveness of our proposed method.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icsidp62679.2024.10869280
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

STIFormer: Spatial-Temporal Interactive Transformer for Dual-Phase Remote Sensing Images Semantic Change Detection

Cai Zitao, Hao Jin, Zheng Lu, Xiaoyang Liang et al.
Remote-Sensing Image Classification
article

STIFormer: Spatial-Temporal Interactive Transformer for Dual-Phase Remote Sensing Images Semantic Change Detection

Cai Zitao, Hao Jin, Zheng Lu, Xiaoyang Liang, Kan Cheng, Li Chengchao
article en

Abstract

The Semantic Change Detection (SCD) in remote sensing images requires accurate extraction of change regions while distinguishing between different types of changes. The temporal span between the two phases is often considerable, resulting in a diverse range of change types across a wide imaging field, with some changes being more apparent than others. Additionally, the scale of change regions can vary from local to global, posing significant challenges for SCD in dual-phase remote sensing images. To address these issues, we propose a semantic change detection method leveraging spatio-temporal dependencies. Firstly, we individually process the dual-phase remote sensing images using an encoder structure with shared weights to extract semantic-level features. These features are then subjected to convolutional operations to generate representations of change regions, enhancing the capability to extract less obvious changes. Subsequently, a transformer structure representing the semantic changes in the dual-phase images is introduced. This structure effectively utilizes the spatio-temporal characteristics of the images to obtain global and change features, addressing the issue of insufficient feature representation for large-scale change regions. Finally, we introduce a semantic learning scheme that utilizes spatio-temporal constraints consistent with the SCD task to guide the learning of semantic changes. The proposed network is evaluated on datasets obtained from high-resolution and resource series satellites, achieving an IOU of 94.49% and an accuracy of 99.04%. These results convincingly demonstrate the effectiveness of our proposed method.

China Academy of Space Technology (CN)
Openalex Percentile: Top 61%
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

STIFormer: Spatial-Temporal Interactive Transformer for Dual-Phase Remote Sensing Images Semantic Change Detection — Cai Zitao, Hao Jin, et al. · (2024) | TGRS Research Map | TGRS