A Comparative Analysis of Industrial MLOps prototype for ML Application Deployment at the edge devices

This paper introduces a prototype for constructing an edge AI system utilizing the contemporary Machine Learning Operations (MLOps) concept. By employing microcontrollers such as the Raspberry Pi as hardware, our methodology includes data scrubbing and machine learning model deployment on edge devices. Crucially, the MLOps pipeline is fully developed within the ecoKI platform, a research platform for ML/AI applications. In this study, we thoroughly investigate the performance of our ecoKI platform by comparing it with the established Edge Impulse platform. We deployed the ML model with different weight quantization methods, such as FP32 and INT8, to compare accuracy variations and inference speed between these two platforms and quantization strategies on edge devices. In our experiments, we identified that the average accuracy performance of the ecoKI platform is 3.61% better than the edge impulse. Moreover, real-time AI processing on edge devices enables microcontrollers, even those with limited resources, to effectively handle tasks in areas such as predictive maintenance, process optimization, quality assurance, and supply chain management.