Evolving the Cloud Block Store with Performance, Elasticity, Availability, and Hardware Offloading
In this paper, we qualitatively and quantitatively discuss the design choices, production experience, and lessons in building the Elastic Block Storage ( EBS ) at Alibaba Cloud over the past decade. To cope with hardware advancement and users’ demands, we shift our focus from design simplicity in EBS1 to high performance and space efficiency in EBS2 , and finally reducing network traffic amplification in EBS3 . In addition to the architectural evolutions, we also summarize development lessons and experiences as four topics, including: (i) achieving high elasticity in latency, throughput, IOPS, and capacity; (ii) improving availability by minimizing the blast radius of individual, regional, and global failure events; (iii) identifying the motivations and key tradeoffs in various hardware offloading solutions; and (iv) identifying the pros/cons of alternative solutions and explaining why seemingly promising ideas would not work in practice.
Authors
- Jiaji Zhu (ORCID: https://orcid.org/0009-0001-7913-2801)
- Tao Ouyang
- Wenyuan Yan
- Zhongjie Wu
- WU Jun-ping
- Wenhui Yao
- Xiaolu Zhang (ORCID: https://orcid.org/0009-0004-6828-4238)
- Jiasheng Wang (ORCID: https://orcid.org/0009-0008-9066-9184)
- Weidong Zhang (ORCID: https://orcid.org/0000-0003-0832-474X)
- Erci Xu (ORCID: https://orcid.org/0000-0002-6654-4364)
- Tianyun Wang (ORCID: https://orcid.org/0000-0001-5507-7505)
- Yinhu Wang
- Jiesheng Wu (ORCID: https://orcid.org/0000-0001-7417-5469)
- Lingjun Zhu (ORCID: https://orcid.org/0009-0001-5145-6097)
- Wenwen Peng (ORCID: https://orcid.org/0009-0000-4700-0225)
- Haoran Zhang (ORCID: https://orcid.org/0009-0003-4428-7111)
- Qiuping Wang (ORCID: https://orcid.org/0000-0001-5361-678X)
- Chao Shi (ORCID: https://orcid.org/0000-0003-0057-6678)
- Yuanyuan Dong (ORCID: https://orcid.org/0000-0002-2744-8652)
- Yilei Peng
- Z. S. Xu (ORCID: https://orcid.org/0000-0002-2511-4675)
- G.F. Dong
- Yuesheng Gu
- Dong Wu (ORCID: https://orcid.org/0009-0005-3376-2057)
- R. Liu (ORCID: https://orcid.org/0000-0002-9854-6137)
- Zhenwei Lu
- Shuo Zhang
Institutions
- Alibaba Group (China) (CN)
Publication Details
- Journal
- ACM Transactions on Storage
- Published
- 2024-12-04
- DOI
- https://doi.org/10.1145/3705925
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00