Direct I/O for RNTuple Columnar Data
RNTuple is the new columnar data format designed as the successor to ROOT’s TTree format. It allows to make use of modern hardware capabilities and is expected to be used in production by the LHC experiments during the HL-LHC. In this paper, we discuss the usage of Direct I/O to fully exploit modern SSDs, especially in the context of the recent addition of parallel RNTuple writing. We describe the alignment requirements imposed by Direct I/O and approaches to meet them for columnar data formats. Finally, we discuss performance results for both writing and reading, in synthetic benchmarks as well as real-world applications.
Authors
- Jonas Hahnfeld
- Jakob Blomer (ORCID: https://orcid.org/0000-0001-9750-6224)
- Philippe Canal (ORCID: https://orcid.org/0000-0002-7748-7887)
- Thorsten Sven Kollegger
Institutions
- Goethe University Frankfurt (DE)
- Fermi National Accelerator Laboratory (US)
- European Organization for Nuclear Research (CH)
Publication Details
- Journal
- EPJ Web of Conferences
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1051/epjconf/202533701034
- Primary Topic
- Algorithms and Data Compression
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Bundesministerium für Bildung und Forschung