Towards multicluster computations with Julia

The ability to aggregate the computational resources of multiple clusters is useful for solving large problems that can benefit from multicluster platforms. In this context, this paper introduces an extension to Julia that enables multilevel parallelism and allows users to exploit use cases of multicluster computation. The proposal is evaluated through a proof-of-concept case study based on the multizone version of the NAS Parallel Benchmarks (NPB-MZ), focusing on evaluating inter-cluster communication and load-balancing overheads.

Authors

Institutions

Publication Details

Published
2024-10-23
DOI
https://doi.org/10.5753/sscad.2024.244307
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards multicluster computations with Julia

Francisco Heron de Carvalho, Tiago Carneiro
Advanced Data Storage Technologies
article

Towards multicluster computations with Julia

Francisco Heron de Carvalho, Tiago Carneiro
article en

Abstract

The ability to aggregate the computational resources of multiple clusters is useful for solving large problems that can benefit from multicluster platforms. In this context, this paper introduces an extension to Julia that enables multilevel parallelism and allows users to exploit use cases of multicluster computation. The proposal is evaluated through a proof-of-concept case study based on the multizone version of the NAS Parallel Benchmarks (NPB-MZ), focusing on evaluating inter-cluster communication and load-balancing overheads.

United Food and Commercial Workers (US), IMEC (BE)
Openalex Percentile: Top 79%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.