A Domain-Specific Memory Bank-Enhanced Framework for Remote Sensing Image Captioning

Remote sensing image captioning enables automated interpretation of remote sensing data for applications such as environmental monitoring and urban planning. However, general-purpose multimodal models exhibit suboptimal adaptability on remote sensing imagery due to domain discrepancies in data distribution, resolution, and rotation invariance. We propose a domain-specific memory bank-enhanced framework for remote sensing image caption, built upon the lightweight EVCap architecture with three core innovations: (1) a remote sensing specific visual memory bank providing domain-representative visual-semantic alignment; (2) a staged transfer training strategy that leverages pre-trained knowledge while mitigating overfitting from limited remote sensing data; and (3) a K-means clustering-based few-shot memory bank that preserves performance while reducing memory footprint for resource-constrained deployment. Extensive experiments on NWPU, RSICD, and Sydney datasets demonstrate substantial improvements over baselines. Specifically, CIDEr increases by 3.3% on RSICD (0.2735 to 0.2825) and 11.7% on Sydney (0.1422 to 0.1589). The proposed method also achieves competitive performance against state-of-the-art methods while maintaining favorable computational efficiency.

Authors

Publication Details

Journal
Remote Sensing
Published
2026-11-04
DOI
https://doi.org/10.3390/rs18213792
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Domain-Specific Memory Bank-Enhanced Framework for Remote Sensing Image Captioning

Gang Wan, Bu Dongdong, Lei Liu, Zhuli Xie
5 links
Remote Sensing
Multimodal Machine Learning Applications
article

A Domain-Specific Memory Bank-Enhanced Framework for Remote Sensing Image Captioning

Gang Wan, Bu Dongdong, Lei Liu, Zhuli Xie
article en

Abstract

Remote sensing image captioning enables automated interpretation of remote sensing data for applications such as environmental monitoring and urban planning. However, general-purpose multimodal models exhibit suboptimal adaptability on remote sensing imagery due to domain discrepancies in data distribution, resolution, and rotation invariance. We propose a domain-specific memory bank-enhanced framework for remote sensing image caption, built upon the lightweight EVCap architecture with three core innovations: (1) a remote sensing specific visual memory bank providing domain-representative visual-semantic alignment; (2) a staged transfer training strategy that leverages pre-trained knowledge while mitigating overfitting from limited remote sensing data; and (3) a K-means clustering-based few-shot memory bank that preserves performance while reducing memory footprint for resource-constrained deployment. Extensive experiments on NWPU, RSICD, and Sydney datasets demonstrate substantial improvements over baselines. Specifically, CIDEr increases by 3.3% on RSICD (0.2735 to 0.2825) and 11.7% on Sydney (0.1422 to 0.1589). The proposed method also achieves competitive performance against state-of-the-art methods while maintaining favorable computational efficiency.

Remote SensingVol. 18(21)
Openalex Percentile: Top 38%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
A Domain-Specific Memory Bank-Enhanced Framework for Remote Sensing Image Captioning — Gang Wan, Bu Dongdong, et al. · Remote Sensing (2026) | TGRS Research Map | TGRS