A Host-CSD Collaborative Framework for High-Performance LSM-Based KV Stores

LSM-based key-value stores are widely used due to their write efficiency and scalability. However, their background compaction process requires substantial data movement between the host and storage devices, resulting in inefficient resource usage, frequent write stalls, and degraded overall throughput. Existing optimizations fail to address the performance bottlenecks caused by excessive system interconnect traffic. Although in-storage computing offers a promising way to mitigate data transfer overhead, prior works typically offload all compaction tasks blindly to computational storage devices. Our preliminary experiments show that such naive offloading leads to performance inefficiency due to CSD resource constraints. In this work, we propose CSD-CoKV + , a host-CSD collaborative framework that enables efficient compaction acceleration for LSM-based KV stores. Specifically, we design a semantic-aware offloader to selectively dispatch suitable compaction jobs to CSDs, together with a lightweight FPGA-based compaction kernel for efficient in-storage execution under constrained device resources. In addition, we develop a range-partitioned data organization with two-level load balancing to preserve locality and improve scalability across CSD arrays, and further introduce a host-device hierarchical cache to better exploit device-level locality in the read path. Evaluations on a real SmartSSD-based prototype show that, with the default host-only baseline, CSD-CoKV + improves write throughput by up to 2.26 × and boosts compaction throughput by up to 3.42 ×, while improving read throughput by up to 28.5%.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Architecture and Code Optimization
Published
2026-10-22
DOI
https://doi.org/10.1145/3859885
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Host-CSD Collaborative Framework for High-Performance LSM-Based KV Stores

Qian Wei, Zhaoyan Shen, Dongxiao Yu, Zehao Chen et al.
ACM Transactions on Architecture and Code Optimization
Advanced Data Storage Technologies
article

A Host-CSD Collaborative Framework for High-Performance LSM-Based KV Stores

Qian Wei, Zhaoyan Shen, Dongxiao Yu, Zehao Chen, Xianwei Meng, Qiang Li, Zhining Cao, Jinrun Yang
article en

Abstract

LSM-based key-value stores are widely used due to their write efficiency and scalability. However, their background compaction process requires substantial data movement between the host and storage devices, resulting in inefficient resource usage, frequent write stalls, and degraded overall throughput. Existing optimizations fail to address the performance bottlenecks caused by excessive system interconnect traffic. Although in-storage computing offers a promising way to mitigate data transfer overhead, prior works typically offload all compaction tasks blindly to computational storage devices. Our preliminary experiments show that such naive offloading leads to performance inefficiency due to CSD resource constraints. In this work, we propose CSD-CoKV + , a host-CSD collaborative framework that enables efficient compaction acceleration for LSM-based KV stores. Specifically, we design a semantic-aware offloader to selectively dispatch suitable compaction jobs to CSDs, together with a lightweight FPGA-based compaction kernel for efficient in-storage execution under constrained device resources. In addition, we develop a range-partitioned data organization with two-level load balancing to preserve locality and improve scalability across CSD arrays, and further introduce a host-device hierarchical cache to better exploit device-level locality in the read path. Evaluations on a real SmartSSD-based prototype show that, with the default host-only baseline, CSD-CoKV + improves write throughput by up to 2.26 × and boosts compaction throughput by up to 3.42 ×, while improving read throughput by up to 28.5%.

ACM Transactions on Architecture and Code Optimization
Shandong University (CN), Chinese Academy of Sciences (CN), Institute of Computing Technology (CN), University of Chinese Academy of Sciences (CN), Tsinghua University (CN)
Openalex Percentile: Top 12%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon