xCache: An Adaptive Compression Strategy for Metadata Cache

Advancements in technologies such as Artificial Intelligence (AI), big data, and Internet of Things (IoT), have driven an exponential growth in the amount of data managed by storage systems. In systems laden with significant data and metadata, rapid and immediate file access becomes crucial. These attributes are essential for maintaining operational efficiency and enhancing user experience. Partially caching of metadata in memory is acknowledged as an effective method to improve file access efficiency. However, the limited capacity of memory can compromise caching effectiveness and cause adverse effects when exceeded. To address this issue, this paper introduces xCache, an effective metadata caching strategy that reduces the memory footprint and improves cache hit rates. The proposed architecture consists of three levels of metadata caching, complemented by an adaptive compression algorithm to maximize its efficiency. Evaluation results demonstrate that xCache can reduce the memory footprint of cached metadata to 13% of its original size, leading to a significant improvement in memory utilization.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/hpcc64274.2024.00013
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

xCache: An Adaptive Compression Strategy for Metadata Cache

Yan Chen, Yongwei Wu
Advanced Data Storage Technologies
article

xCache: An Adaptive Compression Strategy for Metadata Cache

Yan Chen, Yongwei Wu
article en

Abstract

Advancements in technologies such as Artificial Intelligence (AI), big data, and Internet of Things (IoT), have driven an exponential growth in the amount of data managed by storage systems. In systems laden with significant data and metadata, rapid and immediate file access becomes crucial. These attributes are essential for maintaining operational efficiency and enhancing user experience. Partially caching of metadata in memory is acknowledged as an effective method to improve file access efficiency. However, the limited capacity of memory can compromise caching effectiveness and cause adverse effects when exceeded. To address this issue, this paper introduces xCache, an effective metadata caching strategy that reduces the memory footprint and improves cache hit rates. The proposed architecture consists of three levels of metadata caching, complemented by an adaptive compression algorithm to maximize its efficiency. Evaluation results demonstrate that xCache can reduce the memory footprint of cached metadata to 13% of its original size, leading to a significant improvement in memory utilization.

Tsinghua University (CN)
Openalex Percentile: Top 64%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.