Exploring Data Caching Policy with Data Access Patterns from dCache System

The dCache storage system at Brookhaven National Laboratory (BNL) serves as a critical cache for the ATLAS collaboration, enabling efficient access to petabytes of data located on tape, remote repositories, and cold storage. Effective cache management is vital to minimize access latency, particularly as operators have observed persistent high-demand datasets that warrant prolonged retention (“pinning”) in disk cache. This study evaluates machine learning (ML) techniques to automate dataset pinning decisions by predicting future access patterns. Our models, which integrate temporal trends and request-specific features, achieve predictive errors significantly below the inherent variability of dataset access patterns. We further explore dynamic updates to these predictions using real-time dCache access logs, enabling adaptive pinning strategies for high-priority datasets. Ongoing work focuses on validating system-wide performance gains under realistic user workloads, with the goal of optimizing resource utilization for large-scale scientific data infrastructures.

Authors

Institutions

Publication Details

Journal
EPJ Web of Conferences
Published
2025-01-01
DOI
https://doi.org/10.1051/epjconf/202533701340
Primary Topic
Caching and Content Delivery
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Data Caching Policy with Data Access Patterns from dCache System

V. Garonne, Kesheng Wu, Shinjae Yoo, E. Lançon et al.
EPJ Web of Conferences
Caching and Content Delivery
article

Exploring Data Caching Policy with Data Access Patterns from dCache System

V. Garonne, Kesheng Wu, Shinjae Yoo, E. Lançon, Alex Sim, Hiro Ito, J. M. Aldrich
article en

Abstract

The dCache storage system at Brookhaven National Laboratory (BNL) serves as a critical cache for the ATLAS collaboration, enabling efficient access to petabytes of data located on tape, remote repositories, and cold storage. Effective cache management is vital to minimize access latency, particularly as operators have observed persistent high-demand datasets that warrant prolonged retention (“pinning”) in disk cache. This study evaluates machine learning (ML) techniques to automate dataset pinning decisions by predicting future access patterns. Our models, which integrate temporal trends and request-specific features, achieve predictive errors significantly below the inherent variability of dataset access patterns. We further explore dynamic updates to these predictions using real-time dCache access logs, enabling adaptive pinning strategies for high-priority datasets. Ongoing work focuses on validating system-wide performance gains under realistic user workloads, with the goal of optimizing resource utilization for large-scale scientific data infrastructures.

EPJ Web of ConferencesVol. 337
Lawrence Berkeley National Laboratory (US), Brookhaven National Laboratory (US), University of California, Berkeley (US)
U.S. Department of Energy, National Energy Research Scientific Computing Center, Office of Science, Advanced Scientific Computing Research
Openalex Percentile: Top 67%
Caching and Content Delivery
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.