EchoNet++: A multilingual soccer match audio commentary dataset

We present a robust, multilingual, and multistage audio analysis pipeline for automatic processing of professional soccer match broadcasts. Rather than proposing a new standalone ASR model, this work introduces a reproducible end-to-end system and systematic component-level analysis that reveal how preprocessing, segmentation, transcription, and translation jointly affect performance under real-world broadcast conditions. The pipeline performs audio extraction, denoising, speech segmentation, transcription, and translation in a unified framework, enabling scalable, language-agnostic audio understanding. Audio is extracted from match videos using FFmpeg, transformed into the frequency domain via FFT, and filtered with a Butterworth bandpass filter (300 Hz-7 kHz) to isolate speech-relevant frequencies. We apply deep learning-based denoising using Demucs and segment speech regions using Silero VAD, followed by categorization of commentator and spectator streams based on temporal and density cues. Each speech segment is transcribed using multiple Automatic Speech Recognition (ASR) models, including Whisper variants (Medium, Large, Turbo) and Insanely Fast Whisper, and non-English transcripts are translated into English. All results, including transcriptions, translations, and metadata (timestamps, segment labels, and language codes), are exported as match-structured JSON files. We evaluate our pipeline on full-match videos from Europe's top leagues, achieving low word error rates, accurate language detection, and consistent segmentation across diverse acoustic conditions. To support reproducible research and downstream tasks such as summarization and analytics, we will publicly release the dataset and processing pipeline.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-02-17
DOI
https://doi.org/10.1038/s41598-026-39884-8
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EchoNet++: A multilingual soccer match audio commentary dataset

Marco Agus, Fahad Majeed, Maria Nazir, Jens Schneider
Scientific Reports
Video Analysis and Summarization
article

EchoNet++: A multilingual soccer match audio commentary dataset

Marco Agus, Fahad Majeed, Maria Nazir, Jens Schneider
article en

Abstract

We present a robust, multilingual, and multistage audio analysis pipeline for automatic processing of professional soccer match broadcasts. Rather than proposing a new standalone ASR model, this work introduces a reproducible end-to-end system and systematic component-level analysis that reveal how preprocessing, segmentation, transcription, and translation jointly affect performance under real-world broadcast conditions. The pipeline performs audio extraction, denoising, speech segmentation, transcription, and translation in a unified framework, enabling scalable, language-agnostic audio understanding. Audio is extracted from match videos using FFmpeg, transformed into the frequency domain via FFT, and filtered with a Butterworth bandpass filter (300 Hz-7 kHz) to isolate speech-relevant frequencies. We apply deep learning-based denoising using Demucs and segment speech regions using Silero VAD, followed by categorization of commentator and spectator streams based on temporal and density cues. Each speech segment is transcribed using multiple Automatic Speech Recognition (ASR) models, including Whisper variants (Medium, Large, Turbo) and Insanely Fast Whisper, and non-English transcripts are translated into English. All results, including transcriptions, translations, and metadata (timestamps, segment labels, and language codes), are exported as match-structured JSON files. We evaluate our pipeline on full-match videos from Europe's top leagues, achieving low word error rates, accurate language detection, and consistent segmentation across diverse acoustic conditions. To support reproducible research and downstream tasks such as summarization and analytics, we will publicly release the dataset and processing pipeline.

Scientific ReportsVol. 16(1)
University of Ulster (GB), University of Lusaka (ZM), Hamad bin Khalifa University (QA)
Fonds National de la Recherche Luxembourg, Qatar National Research Fund, Qatar National Library
Openalex Percentile: Top 53%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.