A Novel Change Detection Method Based on Visual Language From High-Resolution Remote Sensing Images

Recently, the release of “all-in-one” foundation models has sparked rapid developments in artificial intelligence. However, due to the fact that these models are typically trained on natural images, their potential in remote sensing remains largely untapped. To address this gap, this article proposes a novel change detection method based on visual language from high-resolution remote sensing images, named VLCD. Specifically, on the text side, we use context optimization to align text–image semantics. On the image side, we construct a side fusion network, which integrates universal features from the foundation model with domain-specific features from remote sensing through a bridging module. In addition, we introduce a change feature computation module to integrate global features, difference features, and textual information. To validate the effectiveness of the proposed method, we conducted comparative experiments on three public datasets. The results show that the proposed VLCD achieved state-of-the-art <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F</i>1-scores and IoUs on these three datasets: LEVIR-CD (90.99%, 83.46%), SYSU-CD (83.05%, 71.01%), and S2Looking (62.75%, 45.89%), outperforming the results obtained through full fine-tuning while using less than one-tenth of the number of parameters.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2024-12-31
DOI
https://doi.org/10.1109/jstars.2024.3524382
Citations
4
Primary Topic
Remote Sensing and Land Use
Type
article
Field-Weighted Citation Impact
1.51
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Change Detection Method Based on Visual Language From High-Resolution Remote Sensing Images

J. F. Qiu, Erzhu Li, Hui Zhang, Xing Li et al.
4 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Remote Sensing and Land Use
1.51
article

A Novel Change Detection Method Based on Visual Language From High-Resolution Remote Sensing Images

J. F. Qiu, Erzhu Li, Hui Zhang, Xing Li, Wei Liu, Lianpeng Zhang
article en
4 citations

Abstract

Recently, the release of “all-in-one” foundation models has sparked rapid developments in artificial intelligence. However, due to the fact that these models are typically trained on natural images, their potential in remote sensing remains largely untapped. To address this gap, this article proposes a novel change detection method based on visual language from high-resolution remote sensing images, named VLCD. Specifically, on the text side, we use context optimization to align text–image semantics. On the image side, we construct a side fusion network, which integrates universal features from the foundation model with domain-specific features from remote sensing through a bridging module. In addition, we introduce a change feature computation module to integrate global features, difference features, and textual information. To validate the effectiveness of the proposed method, we conducted comparative experiments on three public datasets. The results show that the proposed VLCD achieved state-of-the-art <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F</i>1-scores and IoUs on these three datasets: LEVIR-CD (90.99%, 83.46%), SYSU-CD (83.05%, 71.01%), and S2Looking (62.75%, 45.89%), outperforming the results obtained through full fine-tuning while using less than one-tenth of the number of parameters.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Jiangsu Normal University (CN)
Openalex Percentile: Top 18%
Remote Sensing and Land Use
1.51
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.