Hadoop Framework to Provide Fault Tolerance in the Cluster

With the vast increase in the amount of information, nearly as high as 90% jump in volume of data compare to previously recorded values only in the past two years.As the data size gets increased, it is essential to have proper facilities to handle these data.Therefore, most of the companies use Hadoop in their application.Hadoop is an open source software that is used for reliable, scalable and distributed computing.Yet Hadoop has its own problems in its architecture which results in point of failure in the job tracker.In this paper, we design a solution to handle the problems that may occur if the job tracker fails.The architecture consists of one job tracker and several task trackers within the cluster.A monitoring agent is assigned to monitor the functionalities of job tracker and replace it with the highly efficient task tracker.The newly assigned job tracker can enhance the knowledge from the backup job tracker.

Authors

Institutions

Publication Details

Published
2025-04-02
DOI
https://doi.org/10.18260/1-2-1153-54025
Citations
1
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hadoop Framework to Provide Fault Tolerance in the Cluster

Amir Esmailpour, S. Balasubramanian
1 citations
Cloud Computing and Resource Management
article

Hadoop Framework to Provide Fault Tolerance in the Cluster

Amir Esmailpour, S. Balasubramanian
article en
1 citations

Abstract

With the vast increase in the amount of information, nearly as high as 90% jump in volume of data compare to previously recorded values only in the past two years.As the data size gets increased, it is essential to have proper facilities to handle these data.Therefore, most of the companies use Hadoop in their application.Hadoop is an open source software that is used for reliable, scalable and distributed computing.Yet Hadoop has its own problems in its architecture which results in point of failure in the job tracker.In this paper, we design a solution to handle the problems that may occur if the job tracker fails.The architecture consists of one job tracker and several task trackers within the cluster.A monitoring agent is assigned to monitor the functionalities of job tracker and replace it with the highly efficient task tracker.The newly assigned job tracker can enhance the knowledge from the backup job tracker.

University of New Haven (US)
Climate action
Openalex Percentile: Top 92%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.