An Adaptive Computation Model for Fault‐Tolerant Execution of Complex Scientific Workflows in Distributed and Federated Cloud Infrastructures

ABSTRACT Complex scientific workflows that involve resource heterogeneity, dynamic failures, and changing workloads pose major challenges when executed across distributed, federated cloud infrastructures. The static execution models traditionally used lack the flexibility to maintain such environments at the required performance and reliability levels. The paper offers an adaptive composition model of fault‐tolerant execution of workflows. The model incorporates: (1) Dynamic Task Migration Engine, which facilitates real‐time task migration to new systems based on failures or performance degradation, (2) predictive fault detection module, which intrinsically predicts a potential system failure using time‐series analysis and system parameters, and (3) adaptive resource provisioning level which dynamically scales up and down the cloud resources according to computation demand. We have tested the model on a hybrid cloud testbed comprising Apache Airflow with custom extensions, as well as on AWS, Google Cloud, and OpenStack. Validations were conducted on benchmark scientific workflows in genomics and environmental modeling across a range of fault scenarios. The final findings indicate a 47% decrease in fault recovery time, a 28% increase in workflow fulfillment speed, and 22% time savings compared to the baseline approaches. The model is scalable and cloud‐agnostic, enabling resilient scientific computing, especially in dynamic and high‐throughput environments. The implications of future work include applying reinforcement learning to optimize policies and support edge‐cloud systems.

Authors

Institutions

Publication Details

Journal
Concurrency and Computation Practice and Experience
Published
2026-02-01
DOI
https://doi.org/10.1002/cpe.70611
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Adaptive Computation Model for Fault‐Tolerant Execution of Complex Scientific Workflows in Distributed and Federated Cloud Infrastructures

R. Kanimozhi, V. Padmavathi
Concurrency and Computation Practice and Experience
Cloud Computing and Resource Management
article

An Adaptive Computation Model for Fault‐Tolerant Execution of Complex Scientific Workflows in Distributed and Federated Cloud Infrastructures

R. Kanimozhi, V. Padmavathi
article en

Abstract

ABSTRACT Complex scientific workflows that involve resource heterogeneity, dynamic failures, and changing workloads pose major challenges when executed across distributed, federated cloud infrastructures. The static execution models traditionally used lack the flexibility to maintain such environments at the required performance and reliability levels. The paper offers an adaptive composition model of fault‐tolerant execution of workflows. The model incorporates: (1) Dynamic Task Migration Engine, which facilitates real‐time task migration to new systems based on failures or performance degradation, (2) predictive fault detection module, which intrinsically predicts a potential system failure using time‐series analysis and system parameters, and (3) adaptive resource provisioning level which dynamically scales up and down the cloud resources according to computation demand. We have tested the model on a hybrid cloud testbed comprising Apache Airflow with custom extensions, as well as on AWS, Google Cloud, and OpenStack. Validations were conducted on benchmark scientific workflows in genomics and environmental modeling across a range of fault scenarios. The final findings indicate a 47% decrease in fault recovery time, a 28% increase in workflow fulfillment speed, and 22% time savings compared to the baseline approaches. The model is scalable and cloud‐agnostic, enabling resilient scientific computing, especially in dynamic and high‐throughput environments. The implications of future work include applying reinforcement learning to optimize policies and support edge‐cloud systems.

Concurrency and Computation Practice and ExperienceVol. 38(4)
Seva Mandir (IN), Centre for Artificial Intelligence and Robotics (IN)
Industry, innovation and infrastructure
Openalex Percentile: Top 72%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Adaptive Computation Model for Fault‐Tolerant Execution of Complex Scientific Workflows in Distributed and Federated Cloud Infrastructures — R. Kanimozhi, V. Padmavathi · Concurrency and Computation Practice and Experience (2026) | TGRS Research Map | TGRS