Automating HPC Software Compilation, Deployment, and Error Resolution through an LLM-based Multi-Agent System

High-performance computing (HPC) systems rely on complex software configurations that are traditionally managed through manual processes, leading to inefficiencies and increased risk of errors.In this paper, we present an LLM-based multi-agent system designed to automate the compilation, deployment, and error resolution of HPC software.Our approach leverages state-of-the-art language models to generate, refine, and iteratively improve build scripts, thereby reducing reliance on static documentation and manual intervention.Extensive experiments on a benchmark cluster demonstrate a 97% success rate in autonomously building over 200 commonly used HPC software packages.Moreover, our agents effectively identify and rectify build and test failures and provide detailed descriptions with actionable recommendations when manual intervention is required.This advancement significantly reduces administrative overhead, enabling HPC administrators to reallocate resources to other critical tasks and paving the way for more resilient and efficient system operations.

Authors

Institutions

Publication Details

Published
2025-07-18
DOI
https://doi.org/10.1145/3708035.3736023
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automating HPC Software Compilation, Deployment, and Error Resolution through an LLM-based Multi-Agent System

Sean Mondesire, Bülent Soykan, Emmanuel Nsiye, G. Martin
Distributed and Parallel Computing Systems
article

Automating HPC Software Compilation, Deployment, and Error Resolution through an LLM-based Multi-Agent System

Sean Mondesire, Bülent Soykan, Emmanuel Nsiye, G. Martin
article en

Abstract

High-performance computing (HPC) systems rely on complex software configurations that are traditionally managed through manual processes, leading to inefficiencies and increased risk of errors.In this paper, we present an LLM-based multi-agent system designed to automate the compilation, deployment, and error resolution of HPC software.Our approach leverages state-of-the-art language models to generate, refine, and iteratively improve build scripts, thereby reducing reliance on static documentation and manual intervention.Extensive experiments on a benchmark cluster demonstrate a 97% success rate in autonomously building over 200 commonly used HPC software packages.Moreover, our agents effectively identify and rectify build and test failures and provide detailed descriptions with actionable recommendations when manual intervention is required.This advancement significantly reduces administrative overhead, enabling HPC administrators to reallocate resources to other critical tasks and paving the way for more resilient and efficient system operations.

University of Central Florida (US)
Openalex Percentile: Top 78%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.