Optimizing Stream Separation Using Event Logs in FDP Storage Devices

The new Non-Volatile Memory express (NVMe) specification, Flexible Data Placement (FDP), introduces a method for improving storage efficiency and performance by reducing the write amplification and ensuring quality of service (QoS). FDP allows hosts to place data into the desired block by specifying the stream in write command. Hosts can reduce write amplification by placing data with similar lifetime in the same block. Additionally, FDP also ensures that each VM uses a different physical die group to minimize performance interference between VMs as much as possible. FDP also has four FDP-specific log pages, of which the Media Reallocated event in the FDP events log was used to experiment with reducing the WAF by reallocating streams by hosts that incorrectly predicted the lifetime of data. Experiments show that this method could significantly reduce the garbage collection cost to almost zero.

Authors

Institutions

Publication Details

Published
2024-08-21
DOI
https://doi.org/10.1109/nvmsa63038.2024.10693666
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimizing Stream Separation Using Event Logs in FDP Storage Devices

Dongkun Shin, Hyunbin Kang
Advanced Data Storage Technologies
article

Optimizing Stream Separation Using Event Logs in FDP Storage Devices

Dongkun Shin, Hyunbin Kang
article en

Abstract

The new Non-Volatile Memory express (NVMe) specification, Flexible Data Placement (FDP), introduces a method for improving storage efficiency and performance by reducing the write amplification and ensuring quality of service (QoS). FDP allows hosts to place data into the desired block by specifying the stream in write command. Hosts can reduce write amplification by placing data with similar lifetime in the same block. Additionally, FDP also ensures that each VM uses a different physical die group to minimize performance interference between VMs as much as possible. FDP also has four FDP-specific log pages, of which the Media Reallocated event in the FDP events log was used to experiment with reducing the WAF by reallocating streams by hosts that incorrectly predicted the lifetime of data. Experiments show that this method could significantly reduce the garbage collection cost to almost zero.

Sungkyunkwan University (KR)
National Research Foundation of Korea
Affordable and clean energy
Openalex Percentile: Top 82%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.