Enhancing CMS data analyses using a distributed high throughput platform
A flexible and dynamic environment capable of accessing distributed data and resources efficiently, is a key aspect for HEP data analysis, especially for the HL-LHC era. A quasi-interactive declarative solution, like ROOT RDataFrame, with scale-up capabilities via open-source standards like Dask, can profit from the "HPC, Big Data and Quantum Computing" Italian Center DataLake model under development. The starting point is a prototypal CMS high throughput analysis platform, offloaded on local Tier-2. This contribution evaluates the scalability, identifies bottlenecks and explores the interactivity of such platform, on two use-cases: a CMS physics analysis with high-rate triggered events and a study of the CMS muon detector performance in phase-space regions driven by analysis needs, accessing detector datasets. The metrics used to evaluate the scaling and speed-up performance will be reported and results will be discussed, emphasising the differences with the legacy analysis workflows.
Authors
- C. Battilana (ORCID: https://orcid.org/0000-0002-3753-3068)
- D. Bonacorsi (ORCID: https://orcid.org/0000-0002-0835-9574)
- Alessandra Fanfani
- T. Diotalevi (ORCID: https://orcid.org/0000-0003-0780-8785)
Publication Details
- Published
- 2025-01-09
- DOI
- https://doi.org/10.22323/1.476.1007
- Primary Topic
- Distributed and Parallel Computing Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- European Commission