Research and Development of Kubernetes Operator for Machine Learning Pipelines

The current research work addresses the problem of automating the delivery of machine learning models from MLflow to Kubernetes infrastructure. To solve the mentioned problem, a Kubernetes operator has been developed to automate the delivery of machine learning models to production by integrating MLflow for model tracking and Seldon Core for model serving. The developed operator allows data scientists to deploy models while maintaining the familiar MLflow environment. The operator's automatic deployment triggers upon tagging models in MLflow, greatly simplifying engineers' tasks and minimizing the need for manual infrastructure configuration. By automating configuration tasks and optimizing deployment workflows, the solution achieves a 40-50% reduction in model time to deployment (TTD) metric compared to manual processes and decreases error rates from 15% to around 3%. The practical relevance of the work is that it simplifies collaboration between data and infrastructure teams by providing a unified deployment framework, resulting in faster, more reliable, and automated integration of machine learning models into an organisation's business processes.