Multiscale Collaborative Attention Network for Robust Multiobject Tracking in Satellite Video

Satellite video has revolutionized Earth observation, offering unprecedented capabilities for automated object tracking. However, multi-object tracking (MOT) in satellite videos remains highly challenging due to complex backgrounds, extremely low signal-to-noise ratios (SNR), and sub-pixel-scale targets. Although existing MOT methods achieve satisfactory performance under conventional conditions, their effectiveness declines significantly when applied to satellite imagery. To address these challenges, we propose a novel MOT framework tailored specifically for remote sensing videos, termed the Multi-scale Collaborative Attention Network (MCANet), which explicitly incorporates temporal and spatial contextual information to enhance tracking performance. Specifically, we design a Collaborative Frame Enhancement Module (CFEM), which improves small-scale target detection by utilizing cross-frame spatiotemporal feature compensation. This module robustly suppresses background interference and enhances weak target features in low-SNR environments. Additionally, we propose a Multi-scale Temporal Attention Motion Capture Module (MTAMC) that integrates multi-layer spatiotemporal attention mechanisms to effectively capture complex motion patterns, significantly improving target association and trajectory continuity under low temporal resolution conditions. Extensive experiments on representative satellite imagery datasets confirm that MCANet substantially outperforms existing state-of-the-art methods, achieving a MOTA score of 69.1% and an IDF1 score of 77.6% on the VISO dataset. These results highlight the effectiveness, robustness, and practical applicability of MCANet in remote sensing MOT scenarios.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/jstars.2025.3626807
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multiscale Collaborative Attention Network for Robust Multiobject Tracking in Satellite Video

Lei Dou, Peng Yang, Jie Dou, Fen Hu
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Video Surveillance and Tracking Methods
article

Multiscale Collaborative Attention Network for Robust Multiobject Tracking in Satellite Video

Lei Dou, Peng Yang, Jie Dou, Fen Hu
article en

Abstract

Satellite video has revolutionized Earth observation, offering unprecedented capabilities for automated object tracking. However, multi-object tracking (MOT) in satellite videos remains highly challenging due to complex backgrounds, extremely low signal-to-noise ratios (SNR), and sub-pixel-scale targets. Although existing MOT methods achieve satisfactory performance under conventional conditions, their effectiveness declines significantly when applied to satellite imagery. To address these challenges, we propose a novel MOT framework tailored specifically for remote sensing videos, termed the Multi-scale Collaborative Attention Network (MCANet), which explicitly incorporates temporal and spatial contextual information to enhance tracking performance. Specifically, we design a Collaborative Frame Enhancement Module (CFEM), which improves small-scale target detection by utilizing cross-frame spatiotemporal feature compensation. This module robustly suppresses background interference and enhances weak target features in low-SNR environments. Additionally, we propose a Multi-scale Temporal Attention Motion Capture Module (MTAMC) that integrates multi-layer spatiotemporal attention mechanisms to effectively capture complex motion patterns, significantly improving target association and trajectory continuity under low temporal resolution conditions. Extensive experiments on representative satellite imagery datasets confirm that MCANet substantially outperforms existing state-of-the-art methods, achieving a MOTA score of 69.1% and an IDF1 score of 77.6% on the VISO dataset. These results highlight the effectiveness, robustness, and practical applicability of MCANet in remote sensing MOT scenarios.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Nanjing University of Science and Technology (CN)
Openalex Percentile: Top 68%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.