Latest Developments of the PUNCH4NFDI Compute and Storage Infrastructures

The PUNCH4NFDI consortium, funded by the German Research Foundation for an initial period of five years, gathers various physics communities - particle, astro-, astroparticle, hadron and nuclear physics - from different institutions embedded in the National Research Data Infrastructure initiative. The goal of PUNCH4NFDI is the establishment of FAIR data management solutions for the participating communities. The federated compute and storage infrastructures made available to the consortium, Compute4PUNCH and Storage4PUNCH, comprise a variety of heterogeneous compute and storage systems. The compute resources are managed by an overlay batch system and COBalD/TARDIS meta-schedulers. The TARDIS resource manager is responsible for the provisioning of resources and their integration in the overlay batch system based on HTCondor, while the COBalD resource balancer optimises the resource utilization by matching the actual demand for a given type of resources. The access to the resources is standardised using a token-based authentication and authorization infrastructure. The refreshment of short-lived access tokens is automated using the HTCondor Credential Manager and the MyToken service. Login nodes define single entry points to the federation, while the use of containers and the CERN Virtual Machine File System ensures a scalable provisioning of virtualized software environments. The latest developments are presented, including the access tokens management and the integration of Compute4PUNCH as a compute backend of the REANA analysis platform.

Authors

Institutions

Publication Details

Journal
EPJ Web of Conferences
Published
2025-01-01
DOI
https://doi.org/10.1051/epjconf/202533701264
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Latest Developments of the PUNCH4NFDI Compute and Storage Infrastructures

A. Drabent, H. Enke, P. Gupta, B. Achkar et al.
EPJ Web of Conferences
Advanced Data Storage Technologies
article

Latest Developments of the PUNCH4NFDI Compute and Storage Infrastructures

A. Drabent, H. Enke, P. Gupta, B. Achkar, B. Roland, A. Khalatyan, M. Hoeft, Christoph Wissing, Oliver Freyermuth, M. Giffels, Michael Huebner, Elena Sacchi
article en

Abstract

The PUNCH4NFDI consortium, funded by the German Research Foundation for an initial period of five years, gathers various physics communities - particle, astro-, astroparticle, hadron and nuclear physics - from different institutions embedded in the National Research Data Infrastructure initiative. The goal of PUNCH4NFDI is the establishment of FAIR data management solutions for the participating communities. The federated compute and storage infrastructures made available to the consortium, Compute4PUNCH and Storage4PUNCH, comprise a variety of heterogeneous compute and storage systems. The compute resources are managed by an overlay batch system and COBalD/TARDIS meta-schedulers. The TARDIS resource manager is responsible for the provisioning of resources and their integration in the overlay batch system based on HTCondor, while the COBalD resource balancer optimises the resource utilization by matching the actual demand for a given type of resources. The access to the resources is standardised using a token-based authentication and authorization infrastructure. The refreshment of short-lived access tokens is automated using the HTCondor Credential Manager and the MyToken service. Login nodes define single entry points to the federation, while the use of containers and the CERN Virtual Machine File System ensures a scalable provisioning of virtualized software environments. The latest developments are presented, including the access tokens management and the integration of Compute4PUNCH as a compute backend of the REANA analysis platform.

EPJ Web of ConferencesVol. 337
Karlsruhe Institute of Technology (DE), University of Bonn (DE), Leibniz Institute for Astrophysics Potsdam (DE), Deutsches Elektronen-Synchrotron DESY (DE), Thüringer Landessternwarte Tautenburg (DE), University of Göttingen (DE)
Openalex Percentile: Top 67%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.