Enhancing Soccer Player Tracking and Re-Identification with Dual Visual Embeddings and Tracklet Association

We present a modular player-tracking pipeline for fixed-viewpoint soccer videos that combines a transformer-based detector (RF-DETR), BoT-SORT for local association, Global Tracklet Association (GTA) for global reconnection, temporal interpolation, and appearance embeddings from CLIP-ReID and PRT-ReID. On the SoccerTrack Challenge ''challenge'' split, the system attains HOTA 0.55, LocA 0.82, and AssA 0.43. We hypothesized that fusing multiple appearance embeddings would consistently improve accuracy. Ablations on two in-domain training sequences show that CLIP-Only performs best, while Proposed (CLIP+PRT) improves over PRT-Only yet does not surpass CLIP-Only. GTA improves ID consistency when paired with interpolation, and reducing detector input resolution from 1456 to 560 substantially degrades accuracy due to weakened small-object detection. These findings indicate that CLIP embeddings are highly discriminative, calibrated fusion is required for PRT to help, and high resolution is a decisive factor. Future work will focus on calibrated fusion and lightweight detection for real-time use.

Authors

Institutions

Publication Details

Published
2025-10-08
DOI
https://doi.org/10.1145/3728423.3759415
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Soccer Player Tracking and Re-Identification with Dual Visual Embeddings and Tracklet Association

Yuki Nakamura
Video Analysis and Summarization
article

Enhancing Soccer Player Tracking and Re-Identification with Dual Visual Embeddings and Tracklet Association

Yuki Nakamura
article en

Abstract

We present a modular player-tracking pipeline for fixed-viewpoint soccer videos that combines a transformer-based detector (RF-DETR), BoT-SORT for local association, Global Tracklet Association (GTA) for global reconnection, temporal interpolation, and appearance embeddings from CLIP-ReID and PRT-ReID. On the SoccerTrack Challenge ''challenge'' split, the system attains HOTA 0.55, LocA 0.82, and AssA 0.43. We hypothesized that fusing multiple appearance embeddings would consistently improve accuracy. Ablations on two in-domain training sequences show that CLIP-Only performs best, while Proposed (CLIP+PRT) improves over PRT-Only yet does not surpass CLIP-Only. GTA improves ID consistency when paired with interpolation, and reducing detector input resolution from 1456 to 560 substantially degrades accuracy due to weakened small-object detection. These findings indicate that CLIP embeddings are highly discriminative, calibrated fusion is required for PRT to help, and high resolution is a decisive factor. Future work will focus on calibrated fusion and lightweight detection for real-time use.

University of Tsukuba (JP)
Openalex Percentile: Top 72%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.