Directed Acyclic Graph-Based Optimization of Apache Flink to Process Streaming Big Data of Industry 4.0
This paper presents a new approach to improve the management of workflow for DAG processing in Apache Flink for further optimization of stream big data. The proposed optimization techniques focus on enhancing the performance metrics of Average Task Execution Time, CPU & Memory Utilization, and System Throughput. Reported experiments demonstrate that the optimized Apache Flink significantly outperforms the baseline version, making it a promising solution for real-time big data analytics.
Authors
- Milton Samadder (ORCID: https://orcid.org/0009-0008-5261-9047)
- Shiladitya Munshi (ORCID: https://orcid.org/0000-0002-4215-6666)
- Anup Kumar Barman (ORCID: https://orcid.org/0000-0002-5697-0431)
- Utpal Madhu
Institutions
- Techno India University (IN)
- Central Institute of Technology Kokrajhar (IN)
Publication Details
- Published
- 2024-11-21
- DOI
- https://doi.org/10.1109/dabcon63472.2024.10919261
- Primary Topic
- E-commerce and Technology Innovations
- Type
- article
- Field-Weighted Citation Impact
- 0.00