Turning data into insights in Jub, an extensible generic big data platform for life science and healthcare applications

This paper presents Jub, a Life Science and Healthcare Data Platform (LSHDP) based on generic sandboxes that integrate AI tools and cloud storage into big data science services. Jub automatically and transparently creates data science services to transform datasets into massive information products by using a profiling methodology. These products are presented by generic-secure cloud-based FAIR observatories adding Programmable, Configurable/Customizing, Adaptable, and Resiliency properties (PCA-FAIR-R). This enables organizations to conduct and customize complex analytics processes to support decision-making. We conducted a study case to convert mortality, climate, and pollutants datasets (2000-2023) reported by the Mexican Government into a solid core hub of information products: 16 strategic data observatories based on 85,171,404 information products created from 114,155,622 spatio-temporal profiles of the International Classification of Diseases (ICD-10) mortality classes/strata and cancerogenic substances. An exploratory study revealed highlights about the significance of breast cancer mortality rate growth showing possible associations with air pollutants. This paper also describes the lessons learned from the practice and experience of implementing Jub sandboxes-based observatories for the Population-based Cancer Registry Network deployed on the Mexican territory in 12 Mexican states by public healthcare institutions, as well as to implement bone cancer deep-learning-based diagnosis at a national Hospital.