The Future of HPC Platforms: Batch scheduler workflows with containers on Kubernetes
Containerising scientific workflows is a revolution, but traditional HPC users worry: "Can Kubernetes handle my complex workloads with familiar scheduling?". This session unveils the power of Kubernetes as a HPC platform that bridges the gap for HPC users. Slurm/PBS-like Scheduling: Manage HPC workloads with hierarchical queues, gang scheduling, and familiar job priorities, using tools such as Yunikorn - a smoother transition from your existing platform. Lift-and-Shift: Migrate monolithic applications, VMs, and MPI jobs onto Kubernetes with minimal disruption. Leverage tools like virtual clusters (vcluster), KubeVirt, and KubeApps for a streamlined process. This session is for you if: - You are an HPC user wrestling with scheduling complexities in Kubernetes. - You are looking to migrate existing HPC environments (applications, VMs, MPI jobs) to Kubernetes. - You want to leverage familiar scheduling concepts with Kubernetes for seamless workflow integration.
Institutions
- Xenon Pharmaceuticals (Canada) (CA)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2024-10-30
- DOI
- https://doi.org/10.5281/zenodo.15293603
- Primary Topic
- Statistical Methods and Bayesian Inference
- Type
- article
- Field-Weighted Citation Impact
- 0.00