Research on the Impact of Interceptors on the Small File Read/Write Performance and Scalability of an All-Flash Storage System

SSDs are rapidly becoming widespread in the form of all-flash storage systems, thanks to their high performance and low power consumption. However, traditional file system stacks are designed with HDDs in mind, and this approach fails to fully leverage the performance of SSDs, especially in latency-sensitive operations such as small file reads and writes, where SSD block I/O latencies can reach the tens of microseconds level. In many artificial intelligence applications, a vast number of files are generated, and the performance of small file reads and writes determines the quality of service. This study focuses on the DAOS storage system as the server and evaluates the impact of interceptors on the performance and scalability of small file reads and writes in scenarios where user space file systems are used as clients. The aim is to provide effective recommendations for achieving kernel-bypass data read and write operations in all-flash storage systems.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/ccpqt64497.2024.00011
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on the Impact of Interceptors on the Small File Read/Write Performance and Scalability of an All-Flash Storage System

Ke Song, Yang Wang, Chao Zheng, Guanlin Dai
Advanced Data Storage Technologies
article

Research on the Impact of Interceptors on the Small File Read/Write Performance and Scalability of an All-Flash Storage System

Ke Song, Yang Wang, Chao Zheng, Guanlin Dai
article en

Abstract

SSDs are rapidly becoming widespread in the form of all-flash storage systems, thanks to their high performance and low power consumption. However, traditional file system stacks are designed with HDDs in mind, and this approach fails to fully leverage the performance of SSDs, especially in latency-sensitive operations such as small file reads and writes, where SSD block I/O latencies can reach the tens of microseconds level. In many artificial intelligence applications, a vast number of files are generated, and the performance of small file reads and writes determines the quality of service. This study focuses on the DAOS storage system as the server and evaluates the impact of interceptors on the performance and scalability of small file reads and writes in scenarios where user space file systems are used as clients. The aim is to provide effective recommendations for achieving kernel-bypass data read and write operations in all-flash storage systems.

China Telecom (China) (CN), China Telecom (CN)
Affordable and clean energy
Openalex Percentile: Top 67%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.