Artificial Intelligence Workloads Forecasting based on Correlation Multi-channels Fusion

Time series forecasting methods are largely used to predict the resource demands of AI workloads in Cloud Computing environments, thereby achieving optimized resource allocation and effective energy conservation. Despite existing efforts of time-series prediction, the accuracy of time series forecasting is often limited by the complexity and dynamics of the input features, especially in multi-channel AI workloads, where the frequent interaction and complex correlation between input features significantly affect the forecasting results. Consequently, a detailed analysis of the correlation between multi-channel input features of AI workloads and their effect on forecasting performance is vital for enhancing the accuracy and reliability of time-series forecasting. We conduct an in-depth analysis on the intricate correlations among multiple input features of AI workloads based on multi-channel inputs using the Alibaba Cloud trace logs to investigate the impacts of such correlations on prediction accuracy. Moreover, we design a novel module, namely a Feature Selection Module (FSM), to fuse highly correlated feature channels, thereby extracting intrinsic correlation information to further improve prediction accuracy. In a 21-feature prediction experiment, our enhanced design, integrating FSM with a Long Short-Term Memory (LSTM) time-series model, achieves 85.71% better results in terms of MAE,MSE and R2 than existing models including LSTM and transformer.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/iucc65928.2024.00024
Primary Topic
Advanced Decision-Making Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Artificial Intelligence Workloads Forecasting based on Correlation Multi-channels Fusion

Yao Lu, Jiayan Gu, Jie Cui, John Panneerselvam et al.
Advanced Decision-Making Techniques
article

Artificial Intelligence Workloads Forecasting based on Correlation Multi-channels Fusion

Yao Lu, Jiayan Gu, Jie Cui, John Panneerselvam, Zheng Lu, Hong Zhong, Xiaoqin Yu, Haoming Zhang
article en

Abstract

Time series forecasting methods are largely used to predict the resource demands of AI workloads in Cloud Computing environments, thereby achieving optimized resource allocation and effective energy conservation. Despite existing efforts of time-series prediction, the accuracy of time series forecasting is often limited by the complexity and dynamics of the input features, especially in multi-channel AI workloads, where the frequent interaction and complex correlation between input features significantly affect the forecasting results. Consequently, a detailed analysis of the correlation between multi-channel input features of AI workloads and their effect on forecasting performance is vital for enhancing the accuracy and reliability of time-series forecasting. We conduct an in-depth analysis on the intricate correlations among multiple input features of AI workloads based on multi-channel inputs using the Alibaba Cloud trace logs to investigate the impacts of such correlations on prediction accuracy. Moreover, we design a novel module, namely a Feature Selection Module (FSM), to fuse highly correlated feature channels, thereby extracting intrinsic correlation information to further improve prediction accuracy. In a 21-feature prediction experiment, our enhanced design, integrating FSM with a Long Short-Term Memory (LSTM) time-series model, achieves 85.71% better results in terms of MAE,MSE and R2 than existing models including LSTM and transformer.

Anhui University (CN), University of Exeter (GB), Hefei University (CN)
Openalex Percentile: Top 50%
Advanced Decision-Making Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.