Semantic Basketball Querying and Temporal Grounding of Play-by-Play Events in Broadcast Video

Basketball play-by-play data provide semi-structured descriptions of game events, but connecting analytical queries to the corresponding moments in broadcast video remains challenging. Towards this direction, this paper presents a semantic framework that integrates basketball play-by-play information into a Knowledge Graph (KG) through the BBall ontology, and links recorded events to temporally grounded video segments using scoreboard-based optical character recognition (OCR). The framework supports multimodal exploitation using structured queries over game events, through the research prototype CourtLens. The latter enables users to retrieve relevant video evidence through a unified semantic interface, including interactive shot charts, filters, SPARQL queries, and natural-language questions through LLM-to-SPARQL. The underlying KG contains 9.5 M play-by-play-related triples covering 1063 games, while the interactive video catalogue currently provides synchronized access to 28 games from 3 EuroLeague seasons. Concerning evaluation, a manually annotated benchmark of 1833 actions from three EuroLeague games yields an overall median absolute temporal error of 4.0 s, with 57.72% and 68.46% of all actions localized within 5 s and 10 s, respectively. Notably, running-clock events (missed/made field goals, assists, rebounds, blocks, steals and turnovers) achieve higher accuracy with 81.04% localized within 5 s and 90.47% within 10 s, demonstrating the system’s effectiveness in temporally grounding actions during active gameplay. Finally, the offline grounding pipeline processes video at 22.74× real time, whereas the interactive CourtLens web application offers real-time interaction for video analysis, e.g., less than 1 s for filter-based search.

Authors

Institutions

Publication Details

Journal
Big Data and Cognitive Computing
Published
2026-11-19
DOI
https://doi.org/10.3390/bdcc10110396
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Semantic Basketball Querying and Temporal Grounding of Play-by-Play Events in Broadcast Video

Michalis Mountantonakis, Theodoros Grammatopoulos, Vasileios Giaramazidis
Big Data and Cognitive Computing
Video Analysis and Summarization
article

Semantic Basketball Querying and Temporal Grounding of Play-by-Play Events in Broadcast Video

Michalis Mountantonakis, Theodoros Grammatopoulos, Vasileios Giaramazidis
article en

Abstract

Basketball play-by-play data provide semi-structured descriptions of game events, but connecting analytical queries to the corresponding moments in broadcast video remains challenging. Towards this direction, this paper presents a semantic framework that integrates basketball play-by-play information into a Knowledge Graph (KG) through the BBall ontology, and links recorded events to temporally grounded video segments using scoreboard-based optical character recognition (OCR). The framework supports multimodal exploitation using structured queries over game events, through the research prototype CourtLens. The latter enables users to retrieve relevant video evidence through a unified semantic interface, including interactive shot charts, filters, SPARQL queries, and natural-language questions through LLM-to-SPARQL. The underlying KG contains 9.5 M play-by-play-related triples covering 1063 games, while the interactive video catalogue currently provides synchronized access to 28 games from 3 EuroLeague seasons. Concerning evaluation, a manually annotated benchmark of 1833 actions from three EuroLeague games yields an overall median absolute temporal error of 4.0 s, with 57.72% and 68.46% of all actions localized within 5 s and 10 s, respectively. Notably, running-clock events (missed/made field goals, assists, rebounds, blocks, steals and turnovers) achieve higher accuracy with 81.04% localized within 5 s and 90.47% within 10 s, demonstrating the system’s effectiveness in temporally grounding actions during active gameplay. Finally, the offline grounding pipeline processes video at 22.74× real time, whereas the interactive CourtLens web application offers real-time interaction for video analysis, e.g., less than 1 s for filter-based search.

Big Data and Cognitive ComputingVol. 10(11)
University of Crete (GR), Foundation for Research and Technology Hellas (GR)
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon