Reference remote sensing image scene segmentation based on multi-scale cross-axis attention network

Segmentation of scenes in remote sensing images represents a crucial and demanding area in the processing of remote sensing image data, merging the fields of computer vision and natural language processing. Traditional image segmentation methods often struggle with the complex spatial scales of remote sensing images and the issue of fuzzy boundaries in segmentation targets, resulting in suboptimal outcomes. To address these challenges, we introduce the Multimodal Information Interaction Network (IMNet), a novel method specifically designed to meet the unique needs of scene segmentation in remote sensing imagery. First, we design an Intra-Modal Information Mining Module (IMM) to effectively handle fine-grained details at multiple scales. Additionally, to better capture global information, we introduce a mechanism to compute double cross-attention between two parallel axial attentions. Our experimental results indicate that our method attains a mean Intersection over Union (mIOU) of 80.46% on our dataset, outperforming current state-of-the-art models and establishing a new standard in the performance of remote sensing image scene segmentation.

Authors

Institutions

Publication Details

Published
2024-11-27
DOI
https://doi.org/10.1117/12.3048920
Primary Topic
Remote Sensing and Land Use
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reference remote sensing image scene segmentation based on multi-scale cross-axis attention network

Jung‐Jeng Su, Yantong Chen
Remote Sensing and Land Use
article

Reference remote sensing image scene segmentation based on multi-scale cross-axis attention network

Jung‐Jeng Su, Yantong Chen
article en

Abstract

Segmentation of scenes in remote sensing images represents a crucial and demanding area in the processing of remote sensing image data, merging the fields of computer vision and natural language processing. Traditional image segmentation methods often struggle with the complex spatial scales of remote sensing images and the issue of fuzzy boundaries in segmentation targets, resulting in suboptimal outcomes. To address these challenges, we introduce the Multimodal Information Interaction Network (IMNet), a novel method specifically designed to meet the unique needs of scene segmentation in remote sensing imagery. First, we design an Intra-Modal Information Mining Module (IMM) to effectively handle fine-grained details at multiple scales. Additionally, to better capture global information, we introduce a mechanism to compute double cross-attention between two parallel axial attentions. Our experimental results indicate that our method attains a mean Intersection over Union (mIOU) of 80.46% on our dataset, outperforming current state-of-the-art models and establishing a new standard in the performance of remote sensing image scene segmentation.

Dalian Maritime University (CN)
Quality Education
Openalex Percentile: Top 75%
Remote Sensing and Land Use
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.