FDTrack: A Dual-Head Focus Tracking Network With Frequency Enhancement

The RGB-T tracking approach combines the advantages of visible and thermal sensors to achieve accurate target tracking in complex scenarios. However, previous RGB-T trackers based on the self-attention (SA) mechanism overlook crucial high-frequency information (such as texture, edges, and colors) that is essential for object prediction. To address these challenges, we propose a frequency-enhanced dual-head focus tracking network (FDTrack) for RGB-T tracking. FDTrack comprises four main components: high-frequency feature enhancement (HFFE), wavelet multifrequency (WMF) interaction, autonomous modality prediction (AMP), and search focus preprocessing (SFP). HFFE refines the features from the ViT backbones within specific modalities by adaptively amplifying high-frequency features. In contrast, WMF facilitates communication between different frequency bands to enhance the interaction of RGB-T features from a frequency perspective. To improve tracking robustness under extreme scenes, AMP incorporates dual prediction heads and determines the final outcome through feature matching. SFP adjusts the convolution kernel size based on pixel-to-target distance and preprocesses the search region with Gaussian blur to reduce background clutter interference and emphasize the target. Extensive experimental results demonstrate that FDTrack achieves competitive performance compared to state-of-the-art algorithms across various datasets, including RGBT210, RGBT234, and LasHeR, showcasing its cutting-edge capabilities in this field.

Authors

Institutions

Publication Details

Journal
IEEE Sensors Journal
Published
2024-12-04
DOI
https://doi.org/10.1109/jsen.2024.3506929
Citations
3
Primary Topic
Advanced Fiber Laser Technologies
Type
article
Field-Weighted Citation Impact
1.01

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FDTrack: A Dual-Head Focus Tracking Network With Frequency Enhancement

Jinde Cao, Zhao Gao, Dongming Zhou, Yisong Liu et al.
3 citations
IEEE Sensors Journal
Advanced Fiber Laser Technologies
1.01
article

FDTrack: A Dual-Head Focus Tracking Network With Frequency Enhancement

Jinde Cao, Zhao Gao, Dongming Zhou, Yisong Liu, Qingchao Shan
article en
3 citations

Abstract

The RGB-T tracking approach combines the advantages of visible and thermal sensors to achieve accurate target tracking in complex scenarios. However, previous RGB-T trackers based on the self-attention (SA) mechanism overlook crucial high-frequency information (such as texture, edges, and colors) that is essential for object prediction. To address these challenges, we propose a frequency-enhanced dual-head focus tracking network (FDTrack) for RGB-T tracking. FDTrack comprises four main components: high-frequency feature enhancement (HFFE), wavelet multifrequency (WMF) interaction, autonomous modality prediction (AMP), and search focus preprocessing (SFP). HFFE refines the features from the ViT backbones within specific modalities by adaptively amplifying high-frequency features. In contrast, WMF facilitates communication between different frequency bands to enhance the interaction of RGB-T features from a frequency perspective. To improve tracking robustness under extreme scenes, AMP incorporates dual prediction heads and determines the final outcome through feature matching. SFP adjusts the convolution kernel size based on pixel-to-target distance and preprocesses the search region with Gaussian blur to reduce background clutter interference and emphasize the target. Extensive experimental results demonstrate that FDTrack achieves competitive performance compared to state-of-the-art algorithms across various datasets, including RGBT210, RGBT234, and LasHeR, showcasing its cutting-edge capabilities in this field.

IEEE Sensors JournalVol. 25(2)
Yunnan University (CN), Southeast University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 23%
Advanced Fiber Laser Technologies
1.01
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.