Using S3 storage with XRootD vs Dynafed
The High Energy Physics Research Computing group at UVic used Dynafed to create federated storage clusters for Belle II and ATLAS that were used by worker nodes deployed on cloud computing facilities around the world. Since the development on Dynafed stopped, XRootD was tested with S3 as backend to replace Dynafed. We will show the similarities as well as the major differences between the two systems for data transfers, checksum calculations as well as clustering of different endpoints, which may help others to efficiently make use of S3 storage as a WLCG site SE.
Authors
- Colson Driemel
- R. Sobie (ORCID: https://orcid.org/0000-0001-7430-7599)
- M. Ebert (ORCID: https://orcid.org/0000-0002-3014-1512)
- T. Sullivan
Institutions
- University of Victoria (CA)
- Institute of Particle Physics (CA)
Publication Details
- Journal
- EPJ Web of Conferences
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1051/epjconf/202533701053
- Primary Topic
- Distributed and Parallel Computing Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00