Directed Acyclic Graph-Based Optimization of Apache Flink to Process Streaming Big Data of Industry 4.0

This paper presents a new approach to improve the management of workflow for DAG processing in Apache Flink for further optimization of stream big data. The proposed optimization techniques focus on enhancing the performance metrics of Average Task Execution Time, CPU & Memory Utilization, and System Throughput. Reported experiments demonstrate that the optimized Apache Flink significantly outperforms the baseline version, making it a promising solution for real-time big data analytics.

Authors

Institutions

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.1109/dabcon63472.2024.10919261
Primary Topic
E-commerce and Technology Innovations
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Directed Acyclic Graph-Based Optimization of Apache Flink to Process Streaming Big Data of Industry 4.0

Milton Samadder, Shiladitya Munshi, Anup Kumar Barman, Utpal Madhu
E-commerce and Technology Innovations
article

Directed Acyclic Graph-Based Optimization of Apache Flink to Process Streaming Big Data of Industry 4.0

Milton Samadder, Shiladitya Munshi, Anup Kumar Barman, Utpal Madhu
article en

Abstract

This paper presents a new approach to improve the management of workflow for DAG processing in Apache Flink for further optimization of stream big data. The proposed optimization techniques focus on enhancing the performance metrics of Average Task Execution Time, CPU & Memory Utilization, and System Throughput. Reported experiments demonstrate that the optimized Apache Flink significantly outperforms the baseline version, making it a promising solution for real-time big data analytics.

Techno India University (IN), Central Institute of Technology Kokrajhar (IN)
Industry, innovation and infrastructure
Openalex Percentile: Top 48%
E-commerce and Technology Innovations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.