Extra-P—Empirical performance modeling made easy
High-performance computing (HPC) applications face challenges in achieving scalability, with bottlenecks often discovered only late in the development cycle. Performance modeling offers a means to predict and understand scalability, but analytical approaches require deep expertise and are often impractical for large, complex codes. To address this, the Extra-P project provides a user-friendly tool for empirical performance modeling, enabling automated model generation from a small number of carefully selected experiments. This paper presents an overview of Extra-P, its underlying methodology—the Performance Model Normal Form (PMNF)—and its evolution into a mature tool for detecting and analyzing scalability issues. We discuss strategies to reduce experiment costs through parameter selection, sparse modeling, and Gaussian process regression, as well as techniques for mitigating the impact of noise using iterative refinement and deep learning. Furthermore, we highlight novel use cases, including segmented modeling and validation of user expectations, and of course demonstrate how Extra-P can uncover hidden bottlenecks in real-world applications such as HOMME or MPI libraries. Finally, we outline the software's architecture and future directions, emphasizing the potential for integration with AI-driven methods and adaptation to increasingly heterogeneous hardware.
Authors
- Florian Wolf (ORCID: https://orcid.org/0000-0001-7251-2951)
- Marcus Ritter (ORCID: https://orcid.org/0000-0001-8550-6614)
- Alexandru Calotoiu (ORCID: https://orcid.org/0000-0001-9095-9108)
- Fabian Czappa (ORCID: https://orcid.org/0000-0001-8422-5706)
- Marcin Copik (ORCID: https://orcid.org/0000-0002-7606-5519)
- Sergei Shudler (ORCID: https://orcid.org/0000-0001-7238-7353)
- Gustavo de Morais
- Torsten Hoefler
- Alexander Geiss
Institutions
- Technische Universität Darmstadt (DE)
- ETH Zurich (CH)
- Hewlett Packard Enterprise (United States) (US)
- ABB (Switzerland) (CH)
Publication Details
- Journal
- Frontiers in High Performance Computing
- Published
- 2026-03-11
- DOI
- https://doi.org/10.3389/fhpcp.2025.1714042
- Primary Topic
- Software System Performance and Reliability
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation
- U.S. Department of Energy
- European Commission
- Deutsche Forschungsgemeinschaft
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung