A Single Machine System for Querying Big Graphs with PRAM
This paper develops Planar (Plug and play PRAM), a single-machine system for graph analytics by reusing existing PRAM algorithms, without the need for designing new parallel algorithms. Planar supports both out-of-core and in-memory analytics. When a graph is too big to fit into the memory of a machine, Planar adapts PRAM to limited resources by extending a fixpoint model with multi-core parallelism, using disk as memory extension. For an in-memory task, it dedicates all available CPU cores to the task, and allows parallelly scalable PRAM algorithms to retain the property, i.e. , the more cores are available, the less runtime is taken. We develop a graph partitioning and work scheduling strategy to accommodate subgraph I/O, balance memory usage and reduce runtime, beyond traditional partitioners for multi-machine systems. Using real-life graphs, we empirically verify that Planar outperforms SOTA in-memory and out-of-core systems in efficiency and scalability.
Authors
- Wenfei Fan (ORCID: https://orcid.org/0000-0001-5149-2656)
- Yang Liu (ORCID: https://orcid.org/0000-0002-5611-5881)
- Jianxin Li (ORCID: https://orcid.org/0000-0002-9059-330X)
- Shuhao Liu (ORCID: https://orcid.org/0000-0002-4892-0979)
- Xiaoke Zhu (ORCID: https://orcid.org/0000-0001-5701-5279)
Institutions
- Beihang University (CN)
- University of Edinburgh (GB)
Publication Details
- Journal
- Proceedings of the VLDB Endowment
- Published
- 2024-11-01
- DOI
- https://doi.org/10.14778/3712221.3712240
- Primary Topic
- Graph Theory and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00