AI Technologies Enhancement Using Data Catalog on Data Lake

Digital transformation (DX) is one of the major challenges for enterprises, which aims to improve their competitiveness by utilizing information technologies. Furthermore, several opportunities of DX have been provided by the remarkable advancement in artificial intelligence (AI) technologies. However, there remains essential difficulties in applying AI to field business, which are caused by the lack of domain knowledge (DK) specific to the enterprise. Data catalog (DC) is data management software employed on data lakes, which is designed to facilitate the utilization of data assets. DC provides data analysts with the enterprise-specific DK to find appropriate data for their analysis. Thus, the DK retained in DC can be beneficial for enhancing AI technologies. Under these considerations, we utilized DC for enhancing AI technologies. By employing the enterprise-specific DK in DC, the performance of AI can be improved with respect to the affinity to the enterprise. We developed two use cases of utilizing DC for enhancing AI technologies. These use cases demonstrate the advantages integrating AI and DC into a system for applying AI to field business, which has not been sufficiently investigated due to the subdivision of research areas.