MACHINE LEARNING STRATEGIES AND ALGORITHMS FOR ENHANCING REAL-TIME DATA PROCESSING IN DYNAMIC AND BIG DATA SYSTEMS
This systematic review article investigated machine learning strategies and algorithms designed to enhance real-time data processing in dynamic and big data environments. As data complexity and volume increased, the need for scalable, adaptable, and computationally efficient solutions became more pressing. Despite significant advances, gaps persisted in handling heterogeneous data sources, ensuring real-time adaptability, and addressing privacy concerns. This article systematically assessed the effectiveness of machine learning models, including supervised, unsupervised, and reinforcement learning, across various dynamic systems. Based on the findings from the literature review, a possible framework was developed, outlining critical processes involved in real-time machine learning, such as data ingestion, feature engineering, model inference, and continuous monitoring. The framework demonstrated methods to improve scalability and performance using cloud computing, edge solutions, and automated model retraining. The findings suggested that emerging trends such as federated learning, ethical AI, and neurosymbolic AI offered promising solutions to unresolved challenges. This article highlighted the importance of continued research to develop robust, secure, and adaptable machine learning frameworks capable of meeting the demands of real-time, high-velocity data processing in increasingly complex environments.
Authors
- Айвар Сахипов (ORCID: https://orcid.org/0000-0003-1045-4199)
- Venera Rystygulova (ORCID: https://orcid.org/0000-0003-3883-5612)
- Aruzhan Mektebayeva
- Aigul Abildina
- Gulmira Omarzhanova
Institutions
- Astana Medical University (KZ)
- Kazakh Technology and Business University named after K.Kulazhanov (KZ)
Publication Details
- Journal
- Вестник КазАТК
- Published
- 2024-09-05
- DOI
- https://doi.org/10.52167/1609-1817-2024-134-5-278-291
- Citations
- 3
- Primary Topic
- Advanced Data Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.98