Lakehouse Data Platform Technology Overview
Since the concept of ‘Lakehouse’ was first introduced in Gartner's Maturity Model report in the field of data management in 2021, it has attracted significant attention as an innovative technology in the context of enterprise digital transformation. An increasing number of enterprises are viewing ‘Lakehouse’ as a crucial infrastructure for their digital transformation. The construction of the lakehouse platform addresses challenges related to the integration of streaming and batch processing, such as atomic transactions, consistent updates, and metadata performance bottlenecks. This enables the lakehouse platform to not only fulfill short-term business needs but also to support long-term data application requirements. This paper elaborates on the development history of data platform, the evolution path of the lakehouse data platform, its implementation solutions, standardization, and future development trends.
Authors
- Yanmei Liu
- Jiafeng Tian
- Xuan Jia (ORCID: https://orcid.org/0000-0002-6069-9445)
- Xiaolu Han
- Shilian Yu
Institutions
- China Academy of Information and Communications Technology (CN)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/iucc65928.2024.00092
- Citations
- 2
- Primary Topic
- Water Quality Monitoring Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.40