The Future of HPC Platforms: Batch scheduler workflows with containers on Kubernetes

Containerising scientific workflows is a revolution, but traditional HPC users worry: "Can Kubernetes handle my complex workloads with familiar scheduling?". This session unveils the power of Kubernetes as a HPC platform that bridges the gap for HPC users. Slurm/PBS-like Scheduling: Manage HPC workloads with hierarchical queues, gang scheduling, and familiar job priorities, using tools such as Yunikorn - a smoother transition from your existing platform. Lift-and-Shift: Migrate monolithic applications, VMs, and MPI jobs onto Kubernetes with minimal disruption. Leverage tools like virtual clusters (vcluster), KubeVirt, and KubeApps for a streamlined process. This session is for you if: - You are an HPC user wrestling with scheduling complexities in Kubernetes. - You are looking to migrate existing HPC environments (applications, VMs, MPI jobs) to Kubernetes. - You want to leverage familiar scheduling concepts with Kubernetes for seamless workflow integration.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-10-30
DOI
https://doi.org/10.5281/zenodo.15293603
Primary Topic
Statistical Methods and Bayesian Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Future of HPC Platforms: Batch scheduler workflows with containers on Kubernetes

Zenodo (CERN European Organization for Nuclear Research)
Statistical Methods and Bayesian Inference
article

The Future of HPC Platforms: Batch scheduler workflows with containers on Kubernetes

article en

Abstract

Containerising scientific workflows is a revolution, but traditional HPC users worry: "Can Kubernetes handle my complex workloads with familiar scheduling?". This session unveils the power of Kubernetes as a HPC platform that bridges the gap for HPC users. Slurm/PBS-like Scheduling: Manage HPC workloads with hierarchical queues, gang scheduling, and familiar job priorities, using tools such as Yunikorn - a smoother transition from your existing platform. Lift-and-Shift: Migrate monolithic applications, VMs, and MPI jobs onto Kubernetes with minimal disruption. Leverage tools like virtual clusters (vcluster), KubeVirt, and KubeApps for a streamlined process. This session is for you if: - You are an HPC user wrestling with scheduling complexities in Kubernetes. - You are looking to migrate existing HPC environments (applications, VMs, MPI jobs) to Kubernetes. - You want to leverage familiar scheduling concepts with Kubernetes for seamless workflow integration.

Zenodo (CERN European Organization for Nuclear Research)
Xenon Pharmaceuticals (Canada) (CA)
Decent work and economic growth, Industry, innovation and infrastructure
Openalex Percentile: Top 53%
Statistical Methods and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.