Data Challenge 2024 – CMS Activities

To verify the readiness of the data distribution infrastructure for the HL-LHC, which is planned to start in 2030, WLCG is organizing a series of data challenges with increasing throughput and complexity. This presentation addresses the contribution of CMS to Data Challenge 2024, which aims to reach 25% of the expected network throughput of the HL-LHC. During the challenge CMS tested various network flows, from the RAW data distribution to the “flexible” model, which adds network traffic resulting from data reprocessing and MC production between most CMS sites. The overall throughput targets were met on the global scale utilizing several hundred links. Valuable information was gathered regarding scaling capabilities of key central services such as Rucio and FTS. During the challenge about half of the transferred volume was carried out via token based authentication. In general sufficient performance of individual links was observed and sites coped with the target throughput. For links that did not reach the target, attempts were made to identify the bottleneck, whether in the transfer tools, the network link, the involved storage systems or other component.

Authors

Institutions

Publication Details

Journal
EPJ Web of Conferences
Published
2025-01-01
DOI
https://doi.org/10.1051/epjconf/202533701185
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data Challenge 2024 – CMS Activities

Katy Ellis, Rahul Chauhan, Christoph Wissing, Hasan Hüseyin Öztürk et al.
EPJ Web of Conferences
Distributed and Parallel Computing Systems
article

Data Challenge 2024 – CMS Activities

Katy Ellis, Rahul Chauhan, Christoph Wissing, Hasan Hüseyin Öztürk, Garyfallia Paspalaki, Andres Manrique Ardila, Panos Paparrigopolos
article en

Abstract

To verify the readiness of the data distribution infrastructure for the HL-LHC, which is planned to start in 2030, WLCG is organizing a series of data challenges with increasing throughput and complexity. This presentation addresses the contribution of CMS to Data Challenge 2024, which aims to reach 25% of the expected network throughput of the HL-LHC. During the challenge CMS tested various network flows, from the RAW data distribution to the “flexible” model, which adds network traffic resulting from data reprocessing and MC production between most CMS sites. The overall throughput targets were met on the global scale utilizing several hundred links. Valuable information was gathered regarding scaling capabilities of key central services such as Rucio and FTS. During the challenge about half of the transferred volume was carried out via token based authentication. In general sufficient performance of individual links was observed and sites coped with the target throughput. For links that did not reach the target, attempts were made to identify the bottleneck, whether in the transfer tools, the network link, the involved storage systems or other component.

EPJ Web of ConferencesVol. 337
Rutherford Appleton Laboratory (GB), University of Wisconsin–Madison (US), Purdue University West Lafayette (US), Deutsches Elektronen-Synchrotron DESY (DE), Research Complex at Harwell (GB), European Organization for Nuclear Research (CH)
Openalex Percentile: Top 68%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Data Challenge 2024 – CMS Activities — Katy Ellis, Rahul Chauhan, et al. · EPJ Web of Conferences (2025) | TGRS Research Map | TGRS