LCKV: Learner-Cleaner Optimized Adaptive Key-Value Separated LSM-Tree Store

Persistent key-value store based on LSM-trees represents one of the most advanced designs. Recent research shows that key-value separation has become a popular optimization method for LSM-tree. However, this storage architecture still incurs significant overhead when dealing with some query- and update-intensive workloads. In this paper, we propose <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\text{LC}\text{KV}$</tex>, a key-value separated LSM-tree storage system built using the <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\underline{L}earner-\underline{C}leaner$</tex> optimization to increase throughput. Learner represents the construction of learned indexes to increase query throughput, responsible for building models for the hot-readcold-written keys stored in the LSM-tree and values stored in the cold-written <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathrm{v}\text{alue logs}$</tex> (vLogs). Cleaner represents the garbage <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathrm{c}\text{ollector}$</tex> (GC) aimedat increasing update throughput, responsible not only for garbage collection but also for maintaining the sorting of the cold-written vLog. Evaluations show that LCKV outperforms other state-of-the-art solutions.

Authors

Institutions

Publication Details

Published
2024-11-18
DOI
https://doi.org/10.1109/iccd63220.2024.00079
Primary Topic
Algorithms and Data Compression
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LCKV: Learner-Cleaner Optimized Adaptive Key-Value Separated LSM-Tree Store

Tianhai Zhao, Mingxuan Liu, Jianhua Gu
Algorithms and Data Compression
article

LCKV: Learner-Cleaner Optimized Adaptive Key-Value Separated LSM-Tree Store

Tianhai Zhao, Mingxuan Liu, Jianhua Gu
article en

Abstract

Persistent key-value store based on LSM-trees represents one of the most advanced designs. Recent research shows that key-value separation has become a popular optimization method for LSM-tree. However, this storage architecture still incurs significant overhead when dealing with some query- and update-intensive workloads. In this paper, we propose <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\text{LC}\text{KV}$</tex>, a key-value separated LSM-tree storage system built using the <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\underline{L}earner-\underline{C}leaner$</tex> optimization to increase throughput. Learner represents the construction of learned indexes to increase query throughput, responsible for building models for the hot-readcold-written keys stored in the LSM-tree and values stored in the cold-written <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathrm{v}\text{alue logs}$</tex> (vLogs). Cleaner represents the garbage <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathrm{c}\text{ollector}$</tex> (GC) aimedat increasing update throughput, responsible not only for garbage collection but also for maintaining the sorting of the cold-written vLog. Evaluations show that LCKV outperforms other state-of-the-art solutions.

Northwestern Polytechnical University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 77%
Algorithms and Data Compression
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.