Data Challenge 2024 – CMS Activities

To verify the readiness of the data distribution infrastructure for the HL-LHC, which is planned to start in 2030, WLCG is organizing a series of data challenges with increasing throughput and complexity. This presentation addresses the contribution of CMS to Data Challenge 2024, which aims to reach 25% of the expected network throughput of the HL-LHC. During the challenge CMS tested various network flows, from the RAW data distribution to the “flexible” model, which adds network traffic resulting from data reprocessing and MC production between most CMS sites. The overall throughput targets were met on the global scale utilizing several hundred links. Valuable information was gathered regarding scaling capabilities of key central services such as Rucio and FTS. During the challenge about half of the transferred volume was carried out via token based authentication. In general sufficient performance of individual links was observed and sites coped with the target throughput. For links that did not reach the target, attempts were made to identify the bottleneck, whether in the transfer tools, the network link, the involved storage systems or other component.

Authors

Publication Details

Journal
Springer Link (Chiba Institute of Technology)
Published
2025-10-07
DOI
https://doi.org/10.1051/epjconf/202533701185/pdf
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data Challenge 2024 – CMS Activities

Rahul Chauhan, Panos Paparrigopolos, Garyfallia Paspalaki, Katy Ellis et al.
Springer Link (Chiba Institute of Technology)
Distributed and Parallel Computing Systems
article

Data Challenge 2024 – CMS Activities

Rahul Chauhan, Panos Paparrigopolos, Garyfallia Paspalaki, Katy Ellis, Christoph Wissing, Hasan Ozturk, Andres Manrique Ardila
article en

Abstract

To verify the readiness of the data distribution infrastructure for the HL-LHC, which is planned to start in 2030, WLCG is organizing a series of data challenges with increasing throughput and complexity. This presentation addresses the contribution of CMS to Data Challenge 2024, which aims to reach 25% of the expected network throughput of the HL-LHC. During the challenge CMS tested various network flows, from the RAW data distribution to the “flexible” model, which adds network traffic resulting from data reprocessing and MC production between most CMS sites. The overall throughput targets were met on the global scale utilizing several hundred links. Valuable information was gathered regarding scaling capabilities of key central services such as Rucio and FTS. During the challenge about half of the transferred volume was carried out via token based authentication. In general sufficient performance of individual links was observed and sites coped with the target throughput. For links that did not reach the target, attempts were made to identify the bottleneck, whether in the transfer tools, the network link, the involved storage systems or other component.

Springer Link (Chiba Institute of Technology)
Industry, innovation and infrastructure
Openalex Percentile: Top 27%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.