M-FSAD-KD: Full-Link Multi-Granularity Distillation for SAR Object Detection

Multi-modal synthetic aperture radar (SAR)–optical object detectors raise detection accuracy by fusing complementary physical responses, but require both modalities to be simultaneously available at inference. When the optical stream becomes unavailable—under heavy cloud cover, night-time conditions, or downlink disruption—the detector reverts to SAR-only operation and accuracy degrades sharply. A natural remedy is to distil a multi-modal teacher into a SAR-only student via privileged-information knowledge distillation. However, we observe that the leading channel-wise feature-level method (CWD) reduces the student’s accuracy below the non-distilled baseline, with its smallest-target AP collapsing to near zero, because SAR speckle and target high-frequency edges share the same band and the alignment loss is dominated by broadband speckle energy. We refer to this failure mode as the speckle-fitting trap, formalize it as a gradient-pollution effect, and validate it through spectral and feature-manifold diagnostics. To counter the trap, we propose M-FSAD-KD, a full-link distillation framework whose neck-stage Fourier-gated alignment transfers low-frequency structural content while preserving target-edge high-frequency content; a joint spatial–channel attention mask, a shallow backbone adapter, and a response-level knowledge distillation (KD) term complete the chain. With a MAIENet teacher on OGSOD-1.0, the advantage of M-FSAD-KD over the strongest response-level KD baseline scales with student capacity: it matches KD on a 2.39 M-parameter student (both ≈48% mean average precision at an intersection-over-union (IoU) threshold of 0.5 (mAP50), averaged over multiple seeds) and exceeds it by 2.0 absolute points on a 19.98 M-parameter student (+8 over the non-distilled baseline), where it is the best of all distillation methods; at full convergence the 19.98 M-parameter student reaches 81.9% mAP50, within 8.9 absolute points of the multi-modal teacher. A frozen-feature transfer test to an out-of-domain SAR benchmark (SSDD ship detection) further shows that distilling from the multi-modal teacher yields substantially more transferable SAR features—about ten absolute points above the non-distilled backbone—with M-FSAD-KD transferring best. Cross-architecture validation with a dual-stream DEYOLO teacher yields 48.6% mAP50 at the student—1.1 absolute points below the MAIENet result—indicating that the framework transfers across the two representative teacher architectures tested (single-stream and dual-stream).

Authors

Institutions

Publication Details

Journal
Remote Sensing
Published
2026-09-04
DOI
https://doi.org/10.3390/rs18173008
Primary Topic
Advanced SAR Imaging Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

M-FSAD-KD: Full-Link Multi-Granularity Distillation for SAR Object Detection

Guixing Cao, Tong Yu, Xinyue Fan, Kaina Xiong et al.
Remote Sensing
Advanced SAR Imaging Techniques
article

M-FSAD-KD: Full-Link Multi-Granularity Distillation for SAR Object Detection

Guixing Cao, Tong Yu, Xinyue Fan, Kaina Xiong, Jun Liu
article en

Abstract

Multi-modal synthetic aperture radar (SAR)–optical object detectors raise detection accuracy by fusing complementary physical responses, but require both modalities to be simultaneously available at inference. When the optical stream becomes unavailable—under heavy cloud cover, night-time conditions, or downlink disruption—the detector reverts to SAR-only operation and accuracy degrades sharply. A natural remedy is to distil a multi-modal teacher into a SAR-only student via privileged-information knowledge distillation. However, we observe that the leading channel-wise feature-level method (CWD) reduces the student’s accuracy below the non-distilled baseline, with its smallest-target AP collapsing to near zero, because SAR speckle and target high-frequency edges share the same band and the alignment loss is dominated by broadband speckle energy. We refer to this failure mode as the speckle-fitting trap, formalize it as a gradient-pollution effect, and validate it through spectral and feature-manifold diagnostics. To counter the trap, we propose M-FSAD-KD, a full-link distillation framework whose neck-stage Fourier-gated alignment transfers low-frequency structural content while preserving target-edge high-frequency content; a joint spatial–channel attention mask, a shallow backbone adapter, and a response-level knowledge distillation (KD) term complete the chain. With a MAIENet teacher on OGSOD-1.0, the advantage of M-FSAD-KD over the strongest response-level KD baseline scales with student capacity: it matches KD on a 2.39 M-parameter student (both ≈48% mean average precision at an intersection-over-union (IoU) threshold of 0.5 (mAP50), averaged over multiple seeds) and exceeds it by 2.0 absolute points on a 19.98 M-parameter student (+8 over the non-distilled baseline), where it is the best of all distillation methods; at full convergence the 19.98 M-parameter student reaches 81.9% mAP50, within 8.9 absolute points of the multi-modal teacher. A frozen-feature transfer test to an out-of-domain SAR benchmark (SSDD ship detection) further shows that distilling from the multi-modal teacher yields substantially more transferable SAR features—about ten absolute points above the non-distilled backbone—with M-FSAD-KD transferring best. Cross-architecture validation with a dual-stream DEYOLO teacher yields 48.6% mAP50 at the student—1.1 absolute points below the MAIENet result—indicating that the framework transfers across the two representative teacher architectures tested (single-stream and dual-stream).

Remote SensingVol. 18(17)
Northeastern University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 7%
Advanced SAR Imaging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.