Attention-based net for updating tracking template

During object tracking process, if only the first frame is used as the matching template, changes about the target state will often lead to poor tracking results or even tracking failure of the classic Siamese tracker. To deal with this issue, UpdateNet uses the first frame as template, and regularly updates the template with combination of the previous accumulated template and the current predicted template. However, the combining of template tends to bring in background information which may pollute the template representation. For the purpose of obtaining accurate template and timely sensing the change of target, this article introduces the Squeeze-and-Excitation channel attention and selective mechanism to UpdateNet. The channel attention mechanism can sort the template information spliced by channels by adjusting the weight to highlight important information. The confidence score of the tracking predicted result of the Siamese network is used to determine whether the corresponding frame should participate in template accumulation, and a threshold is set to exclude severely contaminated predicted templates. The article also uses a more detailed parameter adjustment method to enable UpdateNet to achieve convergence faster and be more adaptive. We apply the improved UpdateNet into the DaSiamRPN tracker, and evaluations on the VOT2016 and VOT2018 datasets show that our methods can effectively improve the performance of UpdateNet.

Authors

Institutions

Publication Details

Published
2024-11-08
DOI
https://doi.org/10.1117/12.3049574
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Attention-based net for updating tracking template

Cheng‐Bin Xiang, Yunfeng Liu, Ying Chen, Dongxu Liu et al.
Advanced Vision and Imaging
article

Attention-based net for updating tracking template

Cheng‐Bin Xiang, Yunfeng Liu, Ying Chen, Dongxu Liu, Jianlin Zhang, Meihui Li, Jie Wang
article en

Abstract

During object tracking process, if only the first frame is used as the matching template, changes about the target state will often lead to poor tracking results or even tracking failure of the classic Siamese tracker. To deal with this issue, UpdateNet uses the first frame as template, and regularly updates the template with combination of the previous accumulated template and the current predicted template. However, the combining of template tends to bring in background information which may pollute the template representation. For the purpose of obtaining accurate template and timely sensing the change of target, this article introduces the Squeeze-and-Excitation channel attention and selective mechanism to UpdateNet. The channel attention mechanism can sort the template information spliced by channels by adjusting the weight to highlight important information. The confidence score of the tracking predicted result of the Siamese network is used to determine whether the corresponding frame should participate in template accumulation, and a threshold is set to exclude severely contaminated predicted templates. The article also uses a more detailed parameter adjustment method to enable UpdateNet to achieve convergence faster and be more adaptive. We apply the improved UpdateNet into the DaSiamRPN tracker, and evaluations on the VOT2016 and VOT2018 datasets show that our methods can effectively improve the performance of UpdateNet.

Chinese Academy of Sciences (CN), Systems Engineering Society of China (CN), Institute of Optics and Electronics, Chinese Academy of Sciences (CN)
No poverty
Openalex Percentile: Top 80%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Attention-based net for updating tracking template — Cheng‐Bin Xiang, Yunfeng Liu, et al. · (2024) | TGRS Research Map | TGRS