TenGraph: A Tensor-Based Graph Query Engine
We propose a novel tensor-based approach to in-memory graph query processing. Tensors are multi-dimensional arrays, and have been utilized as data units in deep learning frameworks such as TensorFlow and PyTorch. Through tensors, these frameworks encapsulate optimized hardware-dependent code for automatic performance improvement on modern processors. Inspired by this practice, we explore how to utilize tensors to efficiently process graph queries. Specifically, we design a succinct storage format for tensors to represent graph topology effectively and compose graph query operations using tensor computation on batches of vertices. We have developed TenGraph, our PyTorch-based prototype, and evaluated it on graph query benchmark workloads in comparison with a variety of CPU- and GPU-based systems. Our experimental results show that TenGraph not only achieves a speedup of 50-100 times on the GPU over the CPU but also outperforms the other CPU- and GPU-based systems significantly.
Authors
- Xibo Sun
- Qiong Luo
- Guanghua Li (ORCID: https://orcid.org/0000-0002-6732-2149)
- Yuanyuan Zhu (ORCID: https://orcid.org/0000-0002-3422-8017)
- Hao Zhang (ORCID: https://orcid.org/0000-0002-9192-4684)
Institutions
- Hong Kong University of Science and Technology (HK)
- Huawei Technologies (China) (CN)
- Wuhan University (CN)
- University of Hong Kong (HK)
Publication Details
- Journal
- Proceedings of the VLDB Endowment
- Published
- 2024-09-01
- DOI
- https://doi.org/10.14778/3704965.3704967
- Citations
- 3
- Primary Topic
- Graph Theory and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.75