The System Design Methodology of an Interactive Big Data Platform Based on Universal LLMs
This work elaborates on the design and implementation of an interactive big data platform system based on a universal LLM, including the main technical implementation plans and module designs of the system. The system employs a stepwise Text-To-SQL approach, utilizing few-shot techniques, RAG, and multi-source heterogeneous data access technologies, which can significantly enhance the direct executability of SQL. Based on this research, we have upgraded the original China Mobile Smart University Big Data Platform, empowered by AI to provide interactive data querying capabilities. This addresses the high professional barriers in data querying and analysis, and the weak front-end user perception of traditional big data platforms. It enables more people to harness the power of data.
Authors
- Peng Jiang (ORCID: https://orcid.org/0000-0002-7828-5486)
- Kairui Yang (ORCID: https://orcid.org/0000-0002-1526-3845)
- Zhixian Zhang (ORCID: https://orcid.org/0009-0007-3852-575X)
- Lina Tang (ORCID: https://orcid.org/0000-0001-7975-2472)
- Yin Bai (ORCID: https://orcid.org/0000-0002-3157-255X)
- Xiaoting Yu (ORCID: https://orcid.org/0000-0002-6117-1044)
Institutions
- China Mobile (China) (CN)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/icise-ie64355.2024.11025394
- Primary Topic
- Data Mining Algorithms and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00