Multi-grained image-text retrieval in farmland remote sensing via multimodal large language models

Low-altitude farmland remote sensing (FRS) has become an important tool for precision agricultural monitoring. However, existing FRS methods are mainly designed for segmentation with predefined categories, making them insufficient for semantic understanding and unable to support flexible natural-language queries. To address this limitation, we introduce an artificial intelligence-based task, FRS cross-modal retrieval, which aims to retrieve target farmland regions from large-scale remote sensing images using textual descriptions. To support this task, we construct the first Farmland Remote Sensing Cross-Modal Retrieval (FRS-CMR) dataset, containing 67,806 image-text pairs generated through multimodal large language models and expert refinement. Based on FRS-CMR, we propose a Farmland-oriented Multi-Grained Retrieval (FarmMGR) framework for image-text alignment. FarmMGR jointly exploits global scene semantics and local region-level cues to capture both large-scale landscape patterns and fine-grained farmland characteristics. To further improve semantic alignment, we design Prototype-Based Semantic Alignment (PBSA) to alleviate the soft-positive sample problem, Global Semantics Hierarchical Feature Integration (GSHFI) to adaptively fuse global and local representations, and Instance-Level Semantic Relation Modeling (ISRM) to capture relational dependencies among farmland instances. In addition, Memory-Enhanced Cross-Modal Contrastive Learning (MECCL) enlarges the negative sample pool and improves representation discrimination. Extensive experiments on FRS-CMR show that FarmMGR achieves a mean recall of 28.57%, outperforming existing image-text retrieval methods and demonstrating its effectiveness for language-driven farmland remote sensing retrieval.

Authors

Institutions

Publication Details

Journal
Engineering Applications of Artificial Intelligence
Published
2026-09-10
DOI
https://doi.org/10.1016/j.engappai.2026.116113
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-grained image-text retrieval in farmland remote sensing via multimodal large language models

Lichuan Gu, Wentao Ma, Lu Liu, KeJian Yu et al.
Engineering Applications of Artificial Intelligence
Multimodal Machine Learning Applications
article

Multi-grained image-text retrieval in farmland remote sensing via multimodal large language models

Lichuan Gu, Wentao Ma, Lu Liu, KeJian Yu, Yuwei Wang, Shichao Jin, Longzhe Quan, Weiwei Wang
article en

Abstract

Low-altitude farmland remote sensing (FRS) has become an important tool for precision agricultural monitoring. However, existing FRS methods are mainly designed for segmentation with predefined categories, making them insufficient for semantic understanding and unable to support flexible natural-language queries. To address this limitation, we introduce an artificial intelligence-based task, FRS cross-modal retrieval, which aims to retrieve target farmland regions from large-scale remote sensing images using textual descriptions. To support this task, we construct the first Farmland Remote Sensing Cross-Modal Retrieval (FRS-CMR) dataset, containing 67,806 image-text pairs generated through multimodal large language models and expert refinement. Based on FRS-CMR, we propose a Farmland-oriented Multi-Grained Retrieval (FarmMGR) framework for image-text alignment. FarmMGR jointly exploits global scene semantics and local region-level cues to capture both large-scale landscape patterns and fine-grained farmland characteristics. To further improve semantic alignment, we design Prototype-Based Semantic Alignment (PBSA) to alleviate the soft-positive sample problem, Global Semantics Hierarchical Feature Integration (GSHFI) to adaptively fuse global and local representations, and Instance-Level Semantic Relation Modeling (ISRM) to capture relational dependencies among farmland instances. In addition, Memory-Enhanced Cross-Modal Contrastive Learning (MECCL) enlarges the negative sample pool and improves representation discrimination. Extensive experiments on FRS-CMR show that FarmMGR achieves a mean recall of 28.57%, outperforming existing image-text retrieval methods and demonstrating its effectiveness for language-driven farmland remote sensing retrieval.

Engineering Applications of Artificial IntelligenceVol. 183
Nanjing Agricultural University (CN), Anhui Agricultural University (CN), Anhui University (CN), Donghua University (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 13%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.