First Deployment of XCache for Workflow and Efficiency Optimizations on Opportunistic HPC Resources in Germany

The future German HEP computing strategy will partially rely on national scientific HPC centers for providing the CPU pledges to the WLCG. The pilot phase for this endeavor is starting in 2025 from which on the share provided by HPC resources will gradually increase. To make this courageous step a success, it is essential that the integrated HPC sites can be utilized just as reliable and efficient for HEP workflows as the traditional, dedicated Grid sites. Motivated by I/O limitations observed at HoreKa, the scientific HPC cluster at KIT, the integration was optimized and an XRootD-based approach for data access bottleneck mitigation was developed and deployed, resulting in a comparable performance of the cluster. This is an important result supporting the future HEP computing strategy in Germany and shows that national scientific HPC centers are capable of delivering the performance and reliability required to be used for providing pledges to the WLCG. Moreover, the findings underline the potential of integrating HPC clusters into the Grid, paving the way for a scalable and sustainable computing infrastructure in the HL-LHC era.

Authors

Institutions

Publication Details

Journal
EPJ Web of Conferences
Published
2025-01-01
DOI
https://doi.org/10.1051/epjconf/202533701084
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

First Deployment of XCache for Workflow and Efficiency Optimizations on Opportunistic HPC Resources in Germany

Robin Hofsaess, Achim Streit, A. Gottmann, G. Quast et al.
EPJ Web of Conferences
Distributed and Parallel Computing Systems
article

First Deployment of XCache for Workflow and Efficiency Optimizations on Opportunistic HPC Resources in Germany

Robin Hofsaess, Achim Streit, A. Gottmann, G. Quast, Andreas Petzold, M. Giffels, M. Schnepf
article en

Abstract

The future German HEP computing strategy will partially rely on national scientific HPC centers for providing the CPU pledges to the WLCG. The pilot phase for this endeavor is starting in 2025 from which on the share provided by HPC resources will gradually increase. To make this courageous step a success, it is essential that the integrated HPC sites can be utilized just as reliable and efficient for HEP workflows as the traditional, dedicated Grid sites. Motivated by I/O limitations observed at HoreKa, the scientific HPC cluster at KIT, the integration was optimized and an XRootD-based approach for data access bottleneck mitigation was developed and deployed, resulting in a comparable performance of the cluster. This is an important result supporting the future HEP computing strategy in Germany and shows that national scientific HPC centers are capable of delivering the performance and reliability required to be used for providing pledges to the WLCG. Moreover, the findings underline the potential of integrating HPC clusters into the Grid, paving the way for a scalable and sustainable computing infrastructure in the HL-LHC era.

EPJ Web of ConferencesVol. 337
Karlsruhe Institute of Technology (DE)
Openalex Percentile: Top 68%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

First Deployment of XCache for Workflow and Efficiency Optimizations on Opportunistic HPC Resources in Germany — Robin Hofsaess, Achim Streit, et al. · EPJ Web of Conferences (2025) | TGRS Research Map | TGRS