Enhancements and resource optimisations for ATLAS use of HammerCloud
HammerCloud (HC) is a framework for testing and benchmarking resources of the world wide LHC computing grid (WLCG). It tests the computing resources and the various components of distributed systems with workloads that can range from very simple functional tests to full-chain experiment workflows. This contribution concentrates on the ATLAS implementation, which makes extensive use of HC for monitoring global resources, and additionally, has implemented a mechanism to automatically exclude resources if certain critical tests fail. The auto-exclusion mechanism makes it possible to save resources by avoiding the submission of computationally intensive jobs to nonfunctioning clusters. However, in some cases central errors of the distributed computing system lead to massive exclusions of otherwise well-functioning resources. A new feature improves the recovery after such mass-exclusion events. For the auto-exclusion mechanism to be effective and save resources, test jobs need to be sent at a sufficient frequency which in turn also uses resources. In this contribution, we give an estimate of the total balance of resources of the auto-exclusion system and explore possible optimisations.
Authors
- B. Rottler (ORCID: https://orcid.org/0000-0002-6762-2213)
- Michael Böhler
- A. M. Lory (ORCID: https://orcid.org/0000-0001-9657-0910)
- Günter Duckeck
Institutions
- University of Freiburg (DE)
- Ludwig-Maximilians-Universität München (DE)
Publication Details
- Journal
- EPJ Web of Conferences
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1051/epjconf/202533701099
- Primary Topic
- Particle Detector Development and Performance
- Type
- article
- Field-Weighted Citation Impact
- 0.00