"The Spartan HPC Story: From Small Scale Experimental to Top500 and Beyond"

Faced with a constrained but an increased need for a general purpose High Performance Computer (HPC) the University of Melbourne s , Spartan , was first made available for researcher use in 2016. A needs evaluation led to the implementation of highly innovative architecture at the time, making use of RoCE and a Cloud-HPC hybrid partition structure. Whilst initially a small system, Spartan attracted a lot of attention with its design with presentations in New Zealand, Australia (eResearch), several European HPC centres (including CERN), and the OpenStack Summit In Barcelona. These early successes led Spartan to receive a substantial grant for a GPU partition for a consortium of Victorian universities that pushed the system into the same metrics as a Top500 system, although it was not until November 2023, that certification was sought and achieved (and that was just a single partition). From a small innovative and cost-effective system designed for general needs, to a world class system, a retrospective of Spartan s history provides insight for information systems management and operational implementation, covering architecture, hardware choices, user engagement, and training. Further, with future portents under consideration, this presentation will outline a roadmap on Spartan s probable future as it heads toward a ten years of operation which, like the fabled Ship of Theseus, engages in a process of development and regeneration.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-10-30
DOI
https://doi.org/10.5281/zenodo.15293565
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

"The Spartan HPC Story: From Small Scale Experimental to Top500 and Beyond"

Zenodo (CERN European Organization for Nuclear Research)
Cloud Computing and Resource Management
article

"The Spartan HPC Story: From Small Scale Experimental to Top500 and Beyond"

article en

Abstract

Faced with a constrained but an increased need for a general purpose High Performance Computer (HPC) the University of Melbourne s , Spartan , was first made available for researcher use in 2016. A needs evaluation led to the implementation of highly innovative architecture at the time, making use of RoCE and a Cloud-HPC hybrid partition structure. Whilst initially a small system, Spartan attracted a lot of attention with its design with presentations in New Zealand, Australia (eResearch), several European HPC centres (including CERN), and the OpenStack Summit In Barcelona. These early successes led Spartan to receive a substantial grant for a GPU partition for a consortium of Victorian universities that pushed the system into the same metrics as a Top500 system, although it was not until November 2023, that certification was sought and achieved (and that was just a single partition). From a small innovative and cost-effective system designed for general needs, to a world class system, a retrospective of Spartan s history provides insight for information systems management and operational implementation, covering architecture, hardware choices, user engagement, and training. Further, with future portents under consideration, this presentation will outline a roadmap on Spartan s probable future as it heads toward a ten years of operation which, like the fabled Ship of Theseus, engages in a process of development and regeneration.

Zenodo (CERN European Organization for Nuclear Research)
The University of Melbourne (AU)
Industry, innovation and infrastructure
Openalex Percentile: Top 42%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

"The Spartan HPC Story: From Small Scale Experimental to Top500 and Beyond" · Zenodo (CERN European Organization for Nuclear Research) (2024) | TGRS Research Map | TGRS