Data Movement Manager (DMM) for the SENSE-Rucio Interoperation Prototype
The Data Movement Manager (DMM) is a prototype interface that connects CERN’s data management software, Rucio, with the Software-Defined Networking (SDN) service SENSE by ESnet. It enables SDN-enabled highenergy physics data flows using the existing worldwide LHC computing grid infrastructure. A key feature of DMM is transfer-priority-based bandwidth allocation, optimizing network usage. Additionally, it provides fine-grained monitoring of underperforming flows by leveraging end-to-end data flow monitoring. This is achieved through access to host-level (network interface) throughput metrics and transfer-tool (FTS) data transfer job-level metrics. This paper details the design and implementation of DMM.
Authors
- J. Guiang (ORCID: https://orcid.org/0000-0002-2155-8260)
- Justas Balcas (ORCID: https://orcid.org/0000-0001-9538-5078)
- Aashay Arora
- Xi Yang (ORCID: https://orcid.org/0000-0001-8977-2303)
- Diego Davila
- H. B. Newman (ORCID: https://orcid.org/0000-0003-0964-1480)
- Tom Lehman
- Frank Würthwein
Institutions
- California Institute of Technology (US)
- San Diego Supercomputer Center (US)
- Energy Sciences Network (US)
Publication Details
- Journal
- EPJ Web of Conferences
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1051/epjconf/202533701208
- Primary Topic
- Software-Defined Networks and 5G
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation
- U.S. Department of Energy
- California Institute of Technology
- San Diego Supercomputer Center