Exploring Data Caching Policy with Data Access Patterns from dCache System
The dCache storage system at Brookhaven National Laboratory (BNL) serves as a critical cache for the ATLAS collaboration, enabling efficient access to petabytes of data located on tape, remote repositories, and cold storage. Effective cache management is vital to minimize access latency, particularly as operators have observed persistent high-demand datasets that warrant prolonged retention (“pinning”) in disk cache. This study evaluates machine learning (ML) techniques to automate dataset pinning decisions by predicting future access patterns. Our models, which integrate temporal trends and request-specific features, achieve predictive errors significantly below the inherent variability of dataset access patterns. We further explore dynamic updates to these predictions using real-time dCache access logs, enabling adaptive pinning strategies for high-priority datasets. Ongoing work focuses on validating system-wide performance gains under realistic user workloads, with the goal of optimizing resource utilization for large-scale scientific data infrastructures.
Authors
- V. Garonne (ORCID: https://orcid.org/0000-0001-7169-9160)
- Kesheng Wu (ORCID: https://orcid.org/0000-0002-6907-3393)
- Shinjae Yoo (ORCID: https://orcid.org/0000-0003-4378-6448)
- E. Lançon (ORCID: https://orcid.org/0000-0002-0225-187X)
- Alex Sim (ORCID: https://orcid.org/0000-0002-6295-1982)
- Hiro Ito
- J. M. Aldrich
Institutions
- Lawrence Berkeley National Laboratory (US)
- Brookhaven National Laboratory (US)
- University of California, Berkeley (US)
Publication Details
- Journal
- EPJ Web of Conferences
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1051/epjconf/202533701340
- Primary Topic
- Caching and Content Delivery
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- U.S. Department of Energy
- National Energy Research Scientific Computing Center
- Office of Science
- Advanced Scientific Computing Research