HLSOT: A Hybrid Learning Framework for Satellite Video Object Tracking

Visual object tracking in satellite videos is essential for remote sensing applications but remains challenging due to small targets, background interference, and appearance changes. Existing methods typically adopt either offline paradigms with high discriminability or online paradigms with strong adaptability, yet neither alone handles the co-occurrence of appearance changes and background interference effectively. To bridge this gap, this study proposes HLSOT, a hybrid learning framework that integrates the complementary strengths of both paradigms. Specifically, a global-spatial adaptive fusion module is designed to dynamically balance the offline and online responses by estimating their global reliability and modulating spatial activations, enabling robust and context-aware fusion. A variation-aware attention module further enhances adaptability through fine-grained feature interaction, capturing both semantic and spatial appearance variations. To improve localization accuracy, particularly for deformable and nonrigid targets, a structure correction head is devised to correct anisotropic localization errors via geometric modeling. Experimental results on the SatSOT, SV248S, and OOTB datasets demonstrate that HLSOT achieves state-of-the-art performance in both robustness and accuracy, particularly under complex scenarios involving multiple simultaneous challenges, while maintaining a real-time speed of over 70 FPS. These results validate the effectiveness and efficiency of the hybrid framework for satellite video object tracking.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/jstars.2025.3607887
Citations
1
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HLSOT: A Hybrid Learning Framework for Satellite Video Object Tracking

You He, Zhizhuo Jiang, H.Y. Wang, Yu Liu et al.
1 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Video Surveillance and Tracking Methods
1.28
article

HLSOT: A Hybrid Learning Framework for Satellite Video Object Tracking

You He, Zhizhuo Jiang, H.Y. Wang, Yu Liu, Gang Li, Xueqian Wang, Yaowen Li, Li Bai
article en
1 citations

Abstract

Visual object tracking in satellite videos is essential for remote sensing applications but remains challenging due to small targets, background interference, and appearance changes. Existing methods typically adopt either offline paradigms with high discriminability or online paradigms with strong adaptability, yet neither alone handles the co-occurrence of appearance changes and background interference effectively. To bridge this gap, this study proposes HLSOT, a hybrid learning framework that integrates the complementary strengths of both paradigms. Specifically, a global-spatial adaptive fusion module is designed to dynamically balance the offline and online responses by estimating their global reliability and modulating spatial activations, enabling robust and context-aware fusion. A variation-aware attention module further enhances adaptability through fine-grained feature interaction, capturing both semantic and spatial appearance variations. To improve localization accuracy, particularly for deformable and nonrigid targets, a structure correction head is devised to correct anisotropic localization errors via geometric modeling. Experimental results on the SatSOT, SV248S, and OOTB datasets demonstrate that HLSOT achieves state-of-the-art performance in both robustness and accuracy, particularly under complex scenarios involving multiple simultaneous challenges, while maintaining a real-time speed of over 70 FPS. These results validate the effectiveness and efficiency of the hybrid framework for satellite video object tracking.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
University Town of Shenzhen (CN), Tsinghua University (CN)
Openalex Percentile: Top 16%
Video Surveillance and Tracking Methods
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.