SUMMIT: A SAR foundation model with multiple auxiliary tasks enhanced intrinsic characteristics
Synthetic Aperture Radar (SAR) is a crucial tool in remote sensing, yet existing deep learning methods are primarily limited in visual representation, neglecting the intrinsic characteristics of SAR and the need for strong generalization across multiple tasks. To address this, we propose SUMMIT (SAR foUndational Model with Multiple auxiliary tasks enhanced Intrinsic characterisTics), a foundational model tailored for SAR image understanding. SUMMIT is pre-trained on the Multi-sensor SAR Image Dataset (MuSID), which contains over 560,000 SAR images. To enhance its feature extraction capability, we introduce a masked image modeling (MIM) framework with self-supervised auxiliary tasks (SSATs): (1) MIM for learning robust structural representations, (2) self-supervised denoising to improve the model’s noise resistance, and (3) space scattering feature enhancement to preserve geometric consistency. Furthermore, we design an auxiliary task coordination module (ATCM) to balance these tasks and ensure effective feature fusion. The resulting self-supervised framework enables SUMMIT to integrate deep learning with SAR’s physical attributes effectively. Extensive experiments across seven datasets and three downstream tasks demonstrate that SUMMIT achieves state-of-the-art performance, particularly in SAR classification, detection, and segmentation. Code and pre-trained model of the proposed SUMMIT will be available at https://github.com/Yunsans/SUMMIT . • This paper explores foundation models with SAR intrinsic fusion. • We build a large dataset with over 560k images for pre-training. • A multi-auxiliary task joint self-supervised framework is proposed. • Denosing and scattering feature enhancement are designed as auxiliary tasks. • All auxiliary tasks are integrated into an end-to-end framework.
Authors
- Yahu Yang (ORCID: https://orcid.org/0000-0002-8532-253X)
- Lingbo Huang (ORCID: https://orcid.org/0000-0003-2713-6867)
- Qian Du (ORCID: https://orcid.org/0000-0001-6991-0844)
- Pedram Ghamisi (ORCID: https://orcid.org/0000-0003-1203-741X)
- Yushi Chen (ORCID: https://orcid.org/0000-0001-8109-2346)
- Yuntao Du (ORCID: https://orcid.org/0000-0002-1206-340X)
Institutions
- Harbin Institute of Technology (CN)
- Helmholtz Institute Freiberg for Resource Technology (DE)
- Mississippi State University (US)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2025-06-11
- DOI
- https://doi.org/10.1016/j.jag.2025.104624
- Primary Topic
- Advanced SAR Imaging Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China