Beyond the Command Line Broadening the scope of HPC Usage

Modern scientific research often requires significant computational, data storage and network resources. For a growing number of workloads, budget constraints prevent purchasing large and often underutilised workstations. Increasingly, no single workstation or even dedicated server suffices for the scale of the computation or data set size involved. Consequently, a high-bandwidth network connection to large-scale, highly performant storage is often the only practical way to conduct a workflow, simulation or analysis. With the rapid growth in large AI model usage and very large data sets being produced by scientific instruments, more researchers than ever face these challenges. High Performance Computers (HPCs) have traditionally solved this problem on the command line with batch schedulers. However, they don't readily enable activities requiring visual feedback and manipulation in real time, and many researchers accustomed to graphical desktop environments find the command line daunting or simply impractical for their workflow. The University of Queensland implemented Open OnDemand to provide a desktop environment on its HPC. This presentation will cover: 1) The need for such a solution, 2) Deciding on and deploying Open OnDemand, 3) Shifting user profiles for HPC, 4) Wins and benefits achieved, and 5) Implications for future HPC hardware expansions and resource management. The talk will highlight exemplars and specific scientific domains that have benefited significantly from the implementation.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-10-31
DOI
https://doi.org/10.5281/zenodo.15293403
Primary Topic
Prenatal Screening and Diagnostics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond the Command Line Broadening the scope of HPC Usage

Zenodo (CERN European Organization for Nuclear Research)
Prenatal Screening and Diagnostics
article

Beyond the Command Line Broadening the scope of HPC Usage

article en

Abstract

Modern scientific research often requires significant computational, data storage and network resources. For a growing number of workloads, budget constraints prevent purchasing large and often underutilised workstations. Increasingly, no single workstation or even dedicated server suffices for the scale of the computation or data set size involved. Consequently, a high-bandwidth network connection to large-scale, highly performant storage is often the only practical way to conduct a workflow, simulation or analysis. With the rapid growth in large AI model usage and very large data sets being produced by scientific instruments, more researchers than ever face these challenges. High Performance Computers (HPCs) have traditionally solved this problem on the command line with batch schedulers. However, they don't readily enable activities requiring visual feedback and manipulation in real time, and many researchers accustomed to graphical desktop environments find the command line daunting or simply impractical for their workflow. The University of Queensland implemented Open OnDemand to provide a desktop environment on its HPC. This presentation will cover: 1) The need for such a solution, 2) Deciding on and deploying Open OnDemand, 3) Shifting user profiles for HPC, 4) Wins and benefits achieved, and 5) Implications for future HPC hardware expansions and resource management. The talk will highlight exemplars and specific scientific domains that have benefited significantly from the implementation.

Zenodo (CERN European Organization for Nuclear Research)
The University of Queensland (AU)
Openalex Percentile: Top 42%
Prenatal Screening and Diagnostics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.