Scalable Cloud Execution Engines

Scalability remains a major concern for many organizations, and as technology evolves expeditiously, the number of users utilizing it also increases rapidly. In this paper, we propose a novel approach to address this challenge through the implementation of a scalable cloud execution engine using a microservices architecture. By using this design we can achieve a system with loosely coupled and independently deployable methods. Also through this, we can achieve enhanced flexibility, scalability, and reusability in our application. Through experimenting with various execution engines it is evident that most of their design relies on monolithic architecture. However, this design poses potential challenges especially when the traffic experiences sudden spikes. Our proposed design provides practical insights for architects and developers seeking to design and deploy highly scalable cloud applications.