Extracting, Transforming, and Analyzing Olympic Data Using Azure Services: A Case Study
A field of investigation and the foundation of cloud computing are employed to administer a common resource pool. Analytics techniques are required in educational mining because of the massive amount of data needed to obtain relevant knowledge. As digital data repositories grow and dispersion, sophisticated data analysis techniques are required to quickly extract relevant knowledge from them. A cloud platform created as a service pipeline for creating and implementing distributed data analytics applications. In this scenario, we make use of learning models, data sets, analysis instruments, and data mining techniques that can be deployed as stand-alone services that can run on clouds. In this study the central focus lies in establishing a robust data pipeline utilizing Azure services, specifically targeting the Tokyo Olympic dataset obtained from Kaggle. The initial phase involves the extraction of relevant information from the Kaggle dataset using Azure Data Factory, a cloud-based integration service. Following this, Azure Databricks, featuring Apache Spark functionality, is employed for the transformation of the Tokyo Olympic data. The primary objective remains to enable advanced analytics, focusing on the Tokyo Olympic dataset. The utilization of Azure Synapse Analytics empowers organizations to perform intricate SQL queries on the Tokyo Olympic data, revealing latent trends and correlations. The outcomes can be visualized through SQL-based approaches in conjunction with Azure Synapse Analytics, providing a comprehensive understanding of the Tokyo Olympic dataset for well- informed decision-making.
Authors
- Pratima Sarkar (ORCID: https://orcid.org/0000-0002-1584-1510)
- Debasis Samanta (ORCID: https://orcid.org/0000-0002-6104-3771)
- Bitan Misra (ORCID: https://orcid.org/0000-0003-4522-1950)
- S Roy (ORCID: https://orcid.org/0009-0007-3942-0781)
Publication Details
- Published
- 2024-09-27
- DOI
- https://doi.org/10.1109/acroset62108.2024.10743877
- Primary Topic
- Software System Performance and Reliability
- Type
- article
- Field-Weighted Citation Impact
- 0.00