Fair Coflow Scheduling via Controlled Slowdown

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress guarantees have been introduced in the literature to mitigate this fairness issue, the trade-off between fairness and efficiency of data transfer is hard to control. This paper introduces a fairness framework for coflow scheduling based on the concept of slowdown, i.e., the performance loss of a coflow compared to isolation. By controlling the slowdown it is possible to enforce a target coflow progress while minimizing the average CCT. In the proposed framework, the minimum slowdown for a batch of coflows can be determined in polynomial time. By showing the equivalence with Gaussian elimination, slowdown constraints are introduced into primal-dual iterations of the CoFair algorithm. The algorithm extends the class of the <inline-formula><tex-math notation="LaTeX">$\sigma$</tex-math></inline-formula>-order schedulers to solve the fair coflow scheduling problem in polynomial time. It provides a 4-approximation of the average CCT w.r.t. an optimal scheduler. Extensive numerical results demonstrate that this approach can trade off average CCT for slowdown more efficiently than existing state of the art schedulers.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Parallel and Distributed Systems
Published
2024-08-20
DOI
https://doi.org/10.1109/tpds.2024.3446188
Citations
2
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
1.56
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fair Coflow Scheduling via Controlled Slowdown

Serigne Guèye, Vaibhav Kumar Gupta, Francesco De Pellegrini, Jérémie Leguay et al.
2 citations
IEEE Transactions on Parallel and Distributed Systems
Cloud Computing and Resource Management
1.56
article

Fair Coflow Scheduling via Controlled Slowdown

Serigne Guèye, Vaibhav Kumar Gupta, Francesco De Pellegrini, Jérémie Leguay, Cédric Richier, Rachid El Azouzi
article en
2 citations

Abstract

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress guarantees have been introduced in the literature to mitigate this fairness issue, the trade-off between fairness and efficiency of data transfer is hard to control. This paper introduces a fairness framework for coflow scheduling based on the concept of slowdown, i.e., the performance loss of a coflow compared to isolation. By controlling the slowdown it is possible to enforce a target coflow progress while minimizing the average CCT. In the proposed framework, the minimum slowdown for a batch of coflows can be determined in polynomial time. By showing the equivalence with Gaussian elimination, slowdown constraints are introduced into primal-dual iterations of the CoFair algorithm. The algorithm extends the class of the <inline-formula><tex-math notation="LaTeX">$\sigma$</tex-math></inline-formula>-order schedulers to solve the fair coflow scheduling problem in polynomial time. It provides a 4-approximation of the average CCT w.r.t. an optimal scheduler. Extensive numerical results demonstrate that this approach can trade off average CCT for slowdown more efficiently than existing state of the art schedulers.

IEEE Transactions on Parallel and Distributed SystemsVol. 35(12)
LNM Institute of Information Technology (IN), Laboratoire Informatique d'Avignon (FR), Huawei Technologies (France) (FR), Infection et inflammation (FR)
Affordable and clean energy
Openalex Percentile: Top 13%
Cloud Computing and Resource Management
1.56
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.