Towards Workload-Specific Configuration Tuning via Meta-Learning for RocksDB
A persistent key-value store, RocksDB, is adapt-able to various workloads and provides fast and low-latency storage for devices that are utilized by numerous applications. RocksDB has been introduced with numerous configuration options for customization and performance optimization. Unfor-tunately, determining an optimal configuration for each given workload remains challenging due to the overwhelming number of options. This complexity is compounded by different types of workloads, thereby requiring efficient configuration tuning. Recent studies have approached automatic tuning techniques to solve this problem by applying reinforcement learning approaches or transferring prior knowledge to predictive models in order to tune unobserved target workloads. However, the former method is time-consuming, and the latter results in unstable optimal performance according to the accuracy of the predictive models. The models trained with prior knowledge, estimate RocksDB performance of given configurations on the target workload, where those workload mismatches degrade tuning performance. To address these challenges, we propose MetaTune, which introduces a meta learner, which is a meta-learning technique, to train a workload -specific predictive model. MetaTune effectively transfers prior knowledge and effi-ciently fine-tunes the model for new workloads. We conducted a comparative analysis of MetaTune with the state-of-the-art baselines across a heterogeneous set of workloads. MetaTune achieved 3.78% to 53.25% improvement in tuning performance compared to the most recent baseline.
Authors
- Jieun Lee (ORCID: https://orcid.org/0000-0003-0609-4370)
- Sang Hyun Park (ORCID: https://orcid.org/0000-0001-7476-1046)
- Sangmin Seo (ORCID: https://orcid.org/0000-0003-4883-3987)
- Chanho Yearn
Institutions
- Yonsei University (KR)
Publication Details
- Published
- 2024-10-06
- DOI
- https://doi.org/10.1109/smc54092.2024.10831422
- Primary Topic
- Software System Performance and Reliability
- Type
- article
- Field-Weighted Citation Impact
- 0.00