VGAC: Predictive Queue Intelligence for GPU Cluster Observability

This talk introduces VGAC — Visualize, Gate, Advise, Calibrate — a calibration-first approach to GPU-cluster queue intelligence. Submit-time queue-risk predictions are useful only if their probabilities are reliable: a "70% risk" should occur about 70% of the time. The talk presents empirical evidence from an Amazon EKS cluster (582 jobs) and an AWS ParallelCluster Slurm deployment showing that (i) Expected Calibration Error (ECE), not AUROC, is the deployment-relevant metric; (ii) a small queue-depth-dominant feature set is sufficient for strong discrimination; (iii) when the cluster scheduler changes (EKS → Slurm), discrimination mostly transfers but calibration does not, motivating per-cluster recalibration as a first-class operational concern. The talk closes with the integration path: validating-admission webhooks on Kubernetes, sacctmgr-based advisories on Slurm, and a roadmap toward conformal prediction intervals. Full paper, code, sample data, trained calibrators, and a one-command reproducibility notebook are released as a companion artifact at Reliability-First-Queue-Risk.

Authors

Institutions

Publication Details

Journal
Open MIND
Published
2026-04-22
DOI
https://doi.org/10.5281/zenodo.19687976
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

VGAC: Predictive Queue Intelligence for GPU Cluster Observability

espira Andrew
Open MIND
Distributed and Parallel Computing Systems
article

VGAC: Predictive Queue Intelligence for GPU Cluster Observability

espira Andrew
article en

Abstract

This talk introduces VGAC — Visualize, Gate, Advise, Calibrate — a calibration-first approach to GPU-cluster queue intelligence. Submit-time queue-risk predictions are useful only if their probabilities are reliable: a "70% risk" should occur about 70% of the time. The talk presents empirical evidence from an Amazon EKS cluster (582 jobs) and an AWS ParallelCluster Slurm deployment showing that (i) Expected Calibration Error (ECE), not AUROC, is the deployment-relevant metric; (ii) a small queue-depth-dominant feature set is sufficient for strong discrimination; (iii) when the cluster scheduler changes (EKS → Slurm), discrimination mostly transfers but calibration does not, motivating per-cluster recalibration as a first-class operational concern. The talk closes with the integration path: validating-admission webhooks on Kubernetes, sacctmgr-based advisories on Slurm, and a roadmap toward conformal prediction intervals. Full paper, code, sample data, trained calibrators, and a one-command reproducibility notebook are released as a companion artifact at Reliability-First-Queue-Risk.

Open MIND
Saint Peter's University (US)
Openalex Percentile: Top 4%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

VGAC: Predictive Queue Intelligence for GPU Cluster Observability — espira Andrew · Open MIND (2026) | TGRS Research Map | TGRS