A big data storage technology based on domestic autonomous controllable characteristics
In view of the characteristics of the target product, such as diverse feature data types, huge capacity, and large number of unstructured and semi-structured data, based on the domestic autonomous controllable platform, we adopt the hybrid storage architecture of massive feature data files combining relational database and Hadoop, and use relational database to store structured feature data. The Hadoop cluster is used to store semi-/ unstructured data, make up for the shortcomings of relational databases in mass data processing and storage, and achieve high concurrent access to big data of target products and scalability of heterogeneous data.
Authors
- Qiujie Zhang (ORCID: https://orcid.org/0009-0008-5660-7983)
- Peng Zhang (ORCID: https://orcid.org/0009-0006-3975-4506)
- Zehao Wang (ORCID: https://orcid.org/0000-0003-4267-5359)
- Pengpeng Huang (ORCID: https://orcid.org/0000-0002-4097-8906)
- Xiangzhen Li (ORCID: https://orcid.org/0009-0006-4905-3922)
- Kan Zhou
Institutions
- Beijing Institute of Technology (CN)
- Beijing Electronic Science and Technology Institute (CN)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1117/12.3047783
- Primary Topic
- Big Data Technologies and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00