Energy-Efficient Big Data Processing Using Adaptive Resource Scheduling in Cloud Environment

This paper proposes an energy-efficient and SLA-aware task scheduling framework for large-scale cloud environments using a hybrid Genetic Algorithm-Whale Optimization Algorithm (GA-WOA) integrated with predictive modeling and explainable AI. The model uses XGBoost regressors to estimate task execution time and resource utilization based on five-dimensional workload vectors extracted from the Alibaba Cluster Trace v2018 dataset, which contains over 1.2 million real-world job instances. Scheduling is performed using a multi-objective fitness function that simultaneously minimizes total energy con-sumption, SLA violation rate, and makespan while ensuring task-to-resource exclusivity and capacity constraints. Experiments conducted on a CloudSim-based simulation environment with 200 physical hosts and 6 baseline methods demonstrated that the proposed approach achieves93.4% precision, 92.1% recall, and 92.7% F1-score.Compared to the best baseline, the proposed model reduces SLA violations from 11.6% to 2.7%, energy usage from 152.6 kWh to 118.3 kWh, and load imbalance from 0.179 to 0.097.Root Mean Square Error (RMSE) was minimized to 0.131 for resource predictions.An ablation study confirmed the critical role of the prediction module, SLA constraint, and migration logic.SHAP-based explainability validated the model's transparency by highlighting CPU demand and data size as dominant scheduling features.

Authors

Institutions

Publication Details

Journal
International Journal of Science and Research (IJSR)
Published
2025-05-10
DOI
https://doi.org/10.21275/sr25503191344
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Energy-Efficient Big Data Processing Using Adaptive Resource Scheduling in Cloud Environment

Nidhin Karunakaran Ponon
International Journal of Science and Research (IJSR)
Cloud Computing and Resource Management
article

Energy-Efficient Big Data Processing Using Adaptive Resource Scheduling in Cloud Environment

Nidhin Karunakaran Ponon
article en

Abstract

This paper proposes an energy-efficient and SLA-aware task scheduling framework for large-scale cloud environments using a hybrid Genetic Algorithm-Whale Optimization Algorithm (GA-WOA) integrated with predictive modeling and explainable AI. The model uses XGBoost regressors to estimate task execution time and resource utilization based on five-dimensional workload vectors extracted from the Alibaba Cluster Trace v2018 dataset, which contains over 1.2 million real-world job instances. Scheduling is performed using a multi-objective fitness function that simultaneously minimizes total energy con-sumption, SLA violation rate, and makespan while ensuring task-to-resource exclusivity and capacity constraints. Experiments conducted on a CloudSim-based simulation environment with 200 physical hosts and 6 baseline methods demonstrated that the proposed approach achieves93.4% precision, 92.1% recall, and 92.7% F1-score.Compared to the best baseline, the proposed model reduces SLA violations from 11.6% to 2.7%, energy usage from 152.6 kWh to 118.3 kWh, and load imbalance from 0.179 to 0.097.Root Mean Square Error (RMSE) was minimized to 0.131 for resource predictions.An ablation study confirmed the critical role of the prediction module, SLA constraint, and migration logic.SHAP-based explainability validated the model's transparency by highlighting CPU demand and data size as dominant scheduling features.

International Journal of Science and Research (IJSR)Vol. 14(5)
Meta (United States) (US)
Openalex Percentile: Top 86%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Energy-Efficient Big Data Processing Using Adaptive Resource Scheduling in Cloud Environment — Nidhin Karunakaran Ponon · International Journal of Science and Research (IJSR) (2025) | TGRS Research Map | TGRS