MACHINE LEARNING STRATEGIES AND ALGORITHMS FOR ENHANCING REAL-TIME DATA PROCESSING IN DYNAMIC AND BIG DATA SYSTEMS

This systematic review article investigated machine learning strategies and algorithms designed to enhance real-time data processing in dynamic and big data environments. As data complexity and volume increased, the need for scalable, adaptable, and computationally efficient solutions became more pressing. Despite significant advances, gaps persisted in handling heterogeneous data sources, ensuring real-time adaptability, and addressing privacy concerns. This article systematically assessed the effectiveness of machine learning models, including supervised, unsupervised, and reinforcement learning, across various dynamic systems. Based on the findings from the literature review, a possible framework was developed, outlining critical processes involved in real-time machine learning, such as data ingestion, feature engineering, model inference, and continuous monitoring. The framework demonstrated methods to improve scalability and performance using cloud computing, edge solutions, and automated model retraining. The findings suggested that emerging trends such as federated learning, ethical AI, and neurosymbolic AI offered promising solutions to unresolved challenges. This article highlighted the importance of continued research to develop robust, secure, and adaptable machine learning frameworks capable of meeting the demands of real-time, high-velocity data processing in increasingly complex environments.

Authors

Institutions

Publication Details

Journal
Вестник КазАТК
Published
2024-09-05
DOI
https://doi.org/10.52167/1609-1817-2024-134-5-278-291
Citations
3
Primary Topic
Advanced Data Processing Techniques
Type
article
Field-Weighted Citation Impact
0.98
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MACHINE LEARNING STRATEGIES AND ALGORITHMS FOR ENHANCING REAL-TIME DATA PROCESSING IN DYNAMIC AND BIG DATA SYSTEMS

Айвар Сахипов, Venera Rystygulova, Aruzhan Mektebayeva, Aigul Abildina et al.
3 citations
Вестник КазАТК
Advanced Data Processing Techniques
0.98
article

MACHINE LEARNING STRATEGIES AND ALGORITHMS FOR ENHANCING REAL-TIME DATA PROCESSING IN DYNAMIC AND BIG DATA SYSTEMS

Айвар Сахипов, Venera Rystygulova, Aruzhan Mektebayeva, Aigul Abildina, Gulmira Omarzhanova
article en
3 citations

Abstract

This systematic review article investigated machine learning strategies and algorithms designed to enhance real-time data processing in dynamic and big data environments. As data complexity and volume increased, the need for scalable, adaptable, and computationally efficient solutions became more pressing. Despite significant advances, gaps persisted in handling heterogeneous data sources, ensuring real-time adaptability, and addressing privacy concerns. This article systematically assessed the effectiveness of machine learning models, including supervised, unsupervised, and reinforcement learning, across various dynamic systems. Based on the findings from the literature review, a possible framework was developed, outlining critical processes involved in real-time machine learning, such as data ingestion, feature engineering, model inference, and continuous monitoring. The framework demonstrated methods to improve scalability and performance using cloud computing, edge solutions, and automated model retraining. The findings suggested that emerging trends such as federated learning, ethical AI, and neurosymbolic AI offered promising solutions to unresolved challenges. This article highlighted the importance of continued research to develop robust, secure, and adaptable machine learning frameworks capable of meeting the demands of real-time, high-velocity data processing in increasingly complex environments.

Вестник КазАТКVol. 134(5)
Astana Medical University (KZ), Kazakh Technology and Business University named after K.Kulazhanov (KZ)
Openalex Percentile: Top 22%
Advanced Data Processing Techniques
0.98
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.