Scaling Parallel Algorithms to Massive Datasets using Multi-SSD Machines
It is now possible in principle to build relatively inexpensive multi-core servers equipped with dozens of terabytes, to even petabytes of local NVMe SSD storage. This raises a natural question of what can be done with such machines, and how many parallel storage devices are required to quickly compute over data that is much larger than main memory? Can we design algorithms for such machines that achieve nearly in-memory performance while gracefully scaling to datasets that are much larger than main memory?
Authors
- H.N. Li (ORCID: https://orcid.org/0009-0003-2739-9613)
- Laxman Dhulipala (ORCID: https://orcid.org/0000-0003-0685-064X)
- Jamshed Khan (ORCID: https://orcid.org/0000-0002-5129-9749)
Institutions
- University of Maryland, College Park (US)
Publication Details
- Published
- 2025-07-16
- DOI
- https://doi.org/10.1145/3694906.3743308
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation