Accounting of Computing Resources with AUDITOR

New strategies for the provisioning of compute resources, e.g. in the form of dynamically integrated resources enabled by the COBalD/TARDIS software toolkit, require a new approach of collecting accounting data. AUDITOR, a flexible and expandable accounting ecosystem that can cover a wide range of use cases and infrastructures, has been developed specifically for this purpose. Accounting data are collected via so-called collectors and stored in a database. So-called plugins can access the data and act based on the accounting information. Access to the data is handled by the core component of AUDITOR, which provides a REST API together with a Rust and a Python client library. An HTCondor collector, a Slurm collector and a TARDIS collector are currently available, and a Kubernetes collector is already in the works. The APEL plugin enables, for example, the creation of APEL accounting summaries and their transmission to the APEL accounting server. Although the original aim for the development of AUDITOR was to enable the accounting of opportunistic resources managed by COBalD/TARDIS, it can also be used for standard accounting of a WLCG computing resource. As AUDITOR uses a highly flexible data structure to store accounting data, extensions such as GPU resource accounting can be added with minimal effort. This contribution provides insights into the design of AUDITOR and shows how it can be used to enable a number of different use cases.

Authors

Institutions

Publication Details

Journal
EPJ Web of Conferences
Published
2025-01-01
DOI
https://doi.org/10.1051/epjconf/202533701320
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Accounting of Computing Resources with AUDITOR

Max Fischer, B. Rottler, Oliver Freyermuth, M. Giffels et al.
EPJ Web of Conferences
Distributed and Parallel Computing Systems
article

Accounting of Computing Resources with AUDITOR

Max Fischer, B. Rottler, Oliver Freyermuth, M. Giffels, R. F. Von Cube, Markus Schumacher, Michael Huebner, M. Schnepf, D. Sammel, Raghuvar Vijayakumar, Raphael Kleinemuehle
article en

Abstract

New strategies for the provisioning of compute resources, e.g. in the form of dynamically integrated resources enabled by the COBalD/TARDIS software toolkit, require a new approach of collecting accounting data. AUDITOR, a flexible and expandable accounting ecosystem that can cover a wide range of use cases and infrastructures, has been developed specifically for this purpose. Accounting data are collected via so-called collectors and stored in a database. So-called plugins can access the data and act based on the accounting information. Access to the data is handled by the core component of AUDITOR, which provides a REST API together with a Rust and a Python client library. An HTCondor collector, a Slurm collector and a TARDIS collector are currently available, and a Kubernetes collector is already in the works. The APEL plugin enables, for example, the creation of APEL accounting summaries and their transmission to the APEL accounting server. Although the original aim for the development of AUDITOR was to enable the accounting of opportunistic resources managed by COBalD/TARDIS, it can also be used for standard accounting of a WLCG computing resource. As AUDITOR uses a highly flexible data structure to store accounting data, extensions such as GPU resource accounting can be added with minimal effort. This contribution provides insights into the design of AUDITOR and shows how it can be used to enable a number of different use cases.

EPJ Web of ConferencesVol. 337
Karlsruhe Institute of Technology (DE), University of Bonn (DE), University of Freiburg (DE), University of Wuppertal (DE)
Deutsche Forschungsgemeinschaft, Bundesministerium für Bildung und Forschung
Openalex Percentile: Top 67%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.