Redesigning Small Payload Transfer Paths for Emerging NVMe SSD Workloads

As modern NVMe SSDs become increasingly capable of in-device computation, workloads such as SQL filtering and key-value store operations are now being offloaded from the host to the SSD. These tasks often involve small payloads, typically a few dozen to hundreds of bytes, which are inefficiently processed by the standard NVMe interface due to its fixed memory page-granularity DMA transfer. Regardless of how small the payload is, even a few dozen bytes, each request still incurs memory page-sized PCIe traffic, resulting in significant bandwidth waste and latency overhead. Existing approaches either require invasive modifications to the I/O stack and SSD internals, or offer only limited benefits for extremely small payloads. This paper presents ByteExpress, a novel mechanism that efficiently transmits small payloads by embedding them inline within NVMe queue entries, embedding for writes and extracting for reads. ByteExpress maintains PCIe traffic efficiency while delivering high performance, all while preserving full compatibility with existing APIs and SSD architectures. Our implementation and evaluation on the Linux NVMe driver and both real hardware and emulation environments, shows up to 96% reduction in PCIe traffic and 25% higher throughput compared with the standard page-based mechanism, and 79% lower latency compared with the state-of-the-art solution.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Storage
Published
2026-11-13
DOI
https://doi.org/10.1145/3861342
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Redesigning Small Payload Transfer Paths for Emerging NVMe SSD Workloads

Junhyeok Park, Jung­hee Lee, Youngjae Kim
3 links
ACM Transactions on Storage
Advanced Data Storage Technologies
article

Redesigning Small Payload Transfer Paths for Emerging NVMe SSD Workloads

Junhyeok Park, Jung­hee Lee, Youngjae Kim
article en

Abstract

As modern NVMe SSDs become increasingly capable of in-device computation, workloads such as SQL filtering and key-value store operations are now being offloaded from the host to the SSD. These tasks often involve small payloads, typically a few dozen to hundreds of bytes, which are inefficiently processed by the standard NVMe interface due to its fixed memory page-granularity DMA transfer. Regardless of how small the payload is, even a few dozen bytes, each request still incurs memory page-sized PCIe traffic, resulting in significant bandwidth waste and latency overhead. Existing approaches either require invasive modifications to the I/O stack and SSD internals, or offer only limited benefits for extremely small payloads. This paper presents ByteExpress, a novel mechanism that efficiently transmits small payloads by embedding them inline within NVMe queue entries, embedding for writes and extracting for reads. ByteExpress maintains PCIe traffic efficiency while delivering high performance, all while preserving full compatibility with existing APIs and SSD architectures. Our implementation and evaluation on the Linux NVMe driver and both real hardware and emulation environments, shows up to 96% reduction in PCIe traffic and 25% higher throughput compared with the standard page-based mechanism, and 79% lower latency compared with the state-of-the-art solution.

ACM Transactions on Storage
Sogang University (KR), Korea University (KR)
Industry, innovation and infrastructure
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon