USING MLOPS FOR DEPLOYMENT OF OPINION MINING MODEL AS A SERVICE FOR SMART CITY APPLICATIONS
This paper presents the MLOps strategy, which adapts the automation principles of DevOps to the deployment and lifecycle management of artificial intelligence (AI) models. By leveraging high-performance automation, MLOps ensures seamless AI development and operations integration, enabling efficient and reliable model deployment. The study demonstrates this approach by implementing the Astana Opinion Mining macro-service customized for sentiment analysis. This macro-service evaluates public opinions based on a criteria taxonomy for assessing the urban environment's sustainable development. As a smart city application, the system facilitates the collection and analysis of citizen feedback to assess the performance of city services and inform urban planning decisions. Technologically, the MLOps strategy employs containers and microservices to construct robust data and process pipelines. Four core pipelines were developed in this research: data collection, feature engineering, experimentation, deployment, and maintenance. The data collection pipeline is achieved through automated crawling from diverse sources such as social media and other internet platforms. The feature engineering pipeline ensures data preprocessing by removing noise, identifying message languages, categorizing topics, and preparing data for further analysis. The experimentation pipeline incorporates services for data labeling, model training, and performance evaluation customized to sentiment analysis tasks. Finally, the deployment pipeline and maintenance pipeline deliver trained models to end-users, ensuring their continual improvement and adaptation. Using this MLOps framework, four models of sentiment analysis were tested in Russian: "Blanchefort," "Sismetanin," "MonoHime," and "Dostoevsky." The "Blanchefort" showed an accuracy of 71,43%. The resulting MLOps framework is fault-tolerant, scalable, and enables real-time urban environment assessments. By automating workflows, the architecture enhances operational efficiency, offering practical applications for smart city initiatives and sustainable urban development, contributing to better decision-making.
Authors
- Didar Yedilkhan (ORCID: https://orcid.org/0000-0002-6343-5277)
- Sanzhar Aubakirov (ORCID: https://orcid.org/0000-0002-8416-527X)
- Aigerim Mussina (ORCID: https://orcid.org/0000-0002-7043-0810)
- Yermek Alimzhanov (ORCID: https://orcid.org/0000-0002-8758-2220)
- Aliya Nugumanova (ORCID: https://orcid.org/0000-0001-5522-4421)
- Aigerim Mansurova (ORCID: https://orcid.org/0009-0003-1978-9574)
Institutions
- Al-Farabi Kazakh National University (KZ)
- Astana Medical University (KZ)
Publication Details
- Journal
- Scientific Journal of Astana IT University
- Published
- 2025-03-30
- DOI
- https://doi.org/10.37943/21cpqx5616
- Citations
- 2
- Primary Topic
- Human Mobility and Location-Based Analysis
- Type
- article
- Field-Weighted Citation Impact
- 4.35