A Task Dependency-Aware Scheduling Strategy for Cross-Domain Stream Computing Environments

In cross-domain stream computing, assigning highly dependent tasks to different domains causes poor performance. Existing methods ignore cross-domain and focus on load balancing and resource allocation. To address this scheduling challenge, this paper proposes a task dependency-aware scheduling strategy named Td-Stream. This strategy is discussed in the following aspects: (1) Impact analysis: Analyzing the adverse impact of communication dependencies between tasks on system performance under traditional scheduling methods in cross-domain environments. (2) Model construction: Constructing models for stream topology, task dependency, resource cost.(3) Cross-domain task allocation: Introducing a cross-domain dependent task allocation method that incorporates a resource elasticity mechanism. Experimental results demonstrate significant improvements made by Td-Stream compared to existing state-of-theart works.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/hpcc64274.2024.00067
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Task Dependency-Aware Scheduling Strategy for Cross-Domain Stream Computing Environments

Rajkumar Buyya, Zhongyuan Zhao, Dawei Sun, Yueru Wang et al.
Cloud Computing and Resource Management
article

A Task Dependency-Aware Scheduling Strategy for Cross-Domain Stream Computing Environments

Rajkumar Buyya, Zhongyuan Zhao, Dawei Sun, Yueru Wang, Shang Gao
article en

Abstract

In cross-domain stream computing, assigning highly dependent tasks to different domains causes poor performance. Existing methods ignore cross-domain and focus on load balancing and resource allocation. To address this scheduling challenge, this paper proposes a task dependency-aware scheduling strategy named Td-Stream. This strategy is discussed in the following aspects: (1) Impact analysis: Analyzing the adverse impact of communication dependencies between tasks on system performance under traditional scheduling methods in cross-domain environments. (2) Model construction: Constructing models for stream topology, task dependency, resource cost.(3) Cross-domain task allocation: Introducing a cross-domain dependent task allocation method that incorporates a resource elasticity mechanism. Experimental results demonstrate significant improvements made by Td-Stream compared to existing state-of-theart works.

Deakin University (AU), China University of Geosciences (Beijing) (CN), Cloud Computing Center (CN)
National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 50%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.