SUMMIT: A SAR foundation model with multiple auxiliary tasks enhanced intrinsic characteristics

Synthetic Aperture Radar (SAR) is a crucial tool in remote sensing, yet existing deep learning methods are primarily limited in visual representation, neglecting the intrinsic characteristics of SAR and the need for strong generalization across multiple tasks. To address this, we propose SUMMIT (SAR foUndational Model with Multiple auxiliary tasks enhanced Intrinsic characterisTics), a foundational model tailored for SAR image understanding. SUMMIT is pre-trained on the Multi-sensor SAR Image Dataset (MuSID), which contains over 560,000 SAR images. To enhance its feature extraction capability, we introduce a masked image modeling (MIM) framework with self-supervised auxiliary tasks (SSATs): (1) MIM for learning robust structural representations, (2) self-supervised denoising to improve the model’s noise resistance, and (3) space scattering feature enhancement to preserve geometric consistency. Furthermore, we design an auxiliary task coordination module (ATCM) to balance these tasks and ensure effective feature fusion. The resulting self-supervised framework enables SUMMIT to integrate deep learning with SAR’s physical attributes effectively. Extensive experiments across seven datasets and three downstream tasks demonstrate that SUMMIT achieves state-of-the-art performance, particularly in SAR classification, detection, and segmentation. Code and pre-trained model of the proposed SUMMIT will be available at https://github.com/Yunsans/SUMMIT . • This paper explores foundation models with SAR intrinsic fusion. • We build a large dataset with over 560k images for pre-training. • A multi-auxiliary task joint self-supervised framework is proposed. • Denosing and scattering feature enhancement are designed as auxiliary tasks. • All auxiliary tasks are integrated into an end-to-end framework.

Authors

Institutions

Publication Details

Journal
International Journal of Applied Earth Observation and Geoinformation
Published
2025-06-11
DOI
https://doi.org/10.1016/j.jag.2025.104624
Primary Topic
Advanced SAR Imaging Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SUMMIT: A SAR foundation model with multiple auxiliary tasks enhanced intrinsic characteristics

Yahu Yang, Lingbo Huang, Qian Du, Pedram Ghamisi et al.
International Journal of Applied Earth Observation and Geoinformation
Advanced SAR Imaging Techniques
article

SUMMIT: A SAR foundation model with multiple auxiliary tasks enhanced intrinsic characteristics

Yahu Yang, Lingbo Huang, Qian Du, Pedram Ghamisi, Yushi Chen, Yuntao Du
article en

Abstract

Synthetic Aperture Radar (SAR) is a crucial tool in remote sensing, yet existing deep learning methods are primarily limited in visual representation, neglecting the intrinsic characteristics of SAR and the need for strong generalization across multiple tasks. To address this, we propose SUMMIT (SAR foUndational Model with Multiple auxiliary tasks enhanced Intrinsic characterisTics), a foundational model tailored for SAR image understanding. SUMMIT is pre-trained on the Multi-sensor SAR Image Dataset (MuSID), which contains over 560,000 SAR images. To enhance its feature extraction capability, we introduce a masked image modeling (MIM) framework with self-supervised auxiliary tasks (SSATs): (1) MIM for learning robust structural representations, (2) self-supervised denoising to improve the model’s noise resistance, and (3) space scattering feature enhancement to preserve geometric consistency. Furthermore, we design an auxiliary task coordination module (ATCM) to balance these tasks and ensure effective feature fusion. The resulting self-supervised framework enables SUMMIT to integrate deep learning with SAR’s physical attributes effectively. Extensive experiments across seven datasets and three downstream tasks demonstrate that SUMMIT achieves state-of-the-art performance, particularly in SAR classification, detection, and segmentation. Code and pre-trained model of the proposed SUMMIT will be available at https://github.com/Yunsans/SUMMIT . • This paper explores foundation models with SAR intrinsic fusion. • We build a large dataset with over 560k images for pre-training. • A multi-auxiliary task joint self-supervised framework is proposed. • Denosing and scattering feature enhancement are designed as auxiliary tasks. • All auxiliary tasks are integrated into an end-to-end framework.

International Journal of Applied Earth Observation and GeoinformationVol. 141
Harbin Institute of Technology (CN), Helmholtz Institute Freiberg for Resource Technology (DE), Mississippi State University (US)
National Natural Science Foundation of China
Climate action
Openalex Percentile: Top 82%
Advanced SAR Imaging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.