Multi-frame Temporal Modeling for Multi-object Tracking in Satellite Video

With the advancement of remote sensing technology, video satellites have played an increasingly important role in both military and civilian domains, and they are widely used in areas such as military guidance, intelligent transportation, and disaster response. Multi-object tracking (MOT) in satellite video is a crucial research topic in these fields and has made certain progress. However, due to the difficulty of tracking objects in complex scene and low resolution, current MOT methods face issues of low accuracy in satellite video. In this work, we propose a joint-detection-and-tracking method called multi-frame temporal MOT (MFT-MOT). Firstly, a heatmap guided multi-frame temporal modeling method is introduced to extract features with temporal semantic information while suppressing background noise. Then, we utilize a weights-shared encoder-decoder network to facilitate interaction of temporal and spatial information and capture inter-frame object motion tracks at low resolution. Experiments on SAT-MTB dataset shows the effectiveness of our method.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icsidp62679.2024.10868570
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-frame Temporal Modeling for Multi-object Tracking in Satellite Video

Jue Wang, Bingqian Chai, Wenchao Liu, Baorong Xie et al.
Video Surveillance and Tracking Methods
article

Multi-frame Temporal Modeling for Multi-object Tracking in Satellite Video

Jue Wang, Bingqian Chai, Wenchao Liu, Baorong Xie, Tingting Qiao
article en

Abstract

With the advancement of remote sensing technology, video satellites have played an increasingly important role in both military and civilian domains, and they are widely used in areas such as military guidance, intelligent transportation, and disaster response. Multi-object tracking (MOT) in satellite video is a crucial research topic in these fields and has made certain progress. However, due to the difficulty of tracking objects in complex scene and low resolution, current MOT methods face issues of low accuracy in satellite video. In this work, we propose a joint-detection-and-tracking method called multi-frame temporal MOT (MFT-MOT). Firstly, a heatmap guided multi-frame temporal modeling method is introduced to extract features with temporal semantic information while suppressing background noise. Then, we utilize a weights-shared encoder-decoder network to facilitate interaction of temporal and spatial information and capture inter-frame object motion tracks at low resolution. Experiments on SAT-MTB dataset shows the effectiveness of our method.

Beijing Institute of Technology (CN), Shanghai Industrial Technology Institute (CN)
Sun Yat-sen University
Openalex Percentile: Top 73%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi-frame Temporal Modeling for Multi-object Tracking in Satellite Video — Jue Wang, Bingqian Chai, et al. · (2024) | TGRS Research Map | TGRS