STRATA: Random Forests going Serverless
Serverless computing has received growing interest in recent years for supporting large-scale machine learning tasks. However, training a machine learning model in a serverless environment is a nontrivial procedure and several challenges still need to be addressed in the data distribution and result aggregation steps as well as the cost of execution due to the inherent complexity of the distributed computation and the coordination required in the learning algorithm. In this work, we focus on Random Forests, a state-of-the-art technique in many Machine Learning applications. We propose STRATA, a cost-effective middleware to train Random Forests atop a serverless environment that successfully addresses these training challenges. As we show in our extensive experimental evaluation STRATA achieves 3X better training times on average compared to a centralized approach and can withstand up to 70% of failures during training.
Authors
- Vana Kalogeraki (ORCID: https://orcid.org/0000-0002-6421-9947)
- Dimitrios Tomaras (ORCID: https://orcid.org/0000-0002-6972-9567)
- Sebastian Buschjäger (ORCID: https://orcid.org/0000-0002-2780-3618)
- Dimitrios Gunopulos (ORCID: https://orcid.org/0000-0001-6339-1879)
- Katharina Morik (ORCID: https://orcid.org/0000-0003-1153-5986)
Institutions
- TU Dortmund University (DE)
- National and Kapodistrian University of Athens (GR)
- Lamarr Institute for Machine Learning and Artificial Intelligence
- Athens University of Economics and Business (GR)
Publication Details
- Published
- 2024-11-27
- DOI
- https://doi.org/10.1145/3652892.3654791
- Citations
- 3
- Primary Topic
- Data Stream Mining Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.04