Preliminary Study on Fine-Grained Power and Energy Measurements on Grace Hopper GH200 with Open-Source Performance Tools
The increasing adoption of tightly integrated, heterogeneous architectures, combined with the slowdown of Moore's law, has made application power and energy-driven optimizations critical to efficiently use high-performance computing systems.This paper introduces a newly developed open-source toolkit that seamlessly integrates the Linux real-time hardware monitoring program hwmon with the Performance Application Programming Interface and the Score-P performance measurement system, thereby enabling finegrained power and energy measurements for high-performance computing applications.Our primary target platform is the Wombat test bed, which is a system based on the NVIDIA GH200 superchip.The toolkit can capture transient power peaks with high temporal resolution (50 ms) and, thanks to Score-P integration, can map power metrics to specific code regions, thereby providing actionable information on power-intensive operations and inefficiencies.The toolkit also provides a holistic view of both the power and the energy consumption of the entire GH200 superchip by covering all major components: the Grace CPU, the Hopper GPU, and the I/O subsystem.Experiments that use Locally Self-consistent Multiple Scattering, which is an application for first-principles calculations of materials developed at Oak Ridge National Laboratory, have demonstrated the tool's ability to identify transient power spikes and uncover opportunities for energy-aware optimizations.Additionally, we introduce a Python-based utility for converting Open Trace Format 2 traces to Parquet format, thus enabling advanced
Authors
- Wael Elwasif (ORCID: https://orcid.org/0000-0003-0554-1036)
- Ross Miller (ORCID: https://orcid.org/0000-0002-2179-495X)
- Markus Eisenbach (ORCID: https://orcid.org/0000-0001-8805-8327)
- Filippo Spiga (ORCID: https://orcid.org/0000-0003-1448-5304)
- Óscar Hernández (ORCID: https://orcid.org/0000-0002-5380-6951)
- T. Wang (ORCID: https://orcid.org/0009-0001-2491-5323)
- Francesca Tartaglione
Institutions
- Oak Ridge National Laboratory (US)
- Nvidia (United Kingdom) (GB)
- Nvidia (United States) (US)
Publication Details
- Published
- 2025-02-19
- DOI
- https://doi.org/10.1145/3703001.3724383
- Citations
- 1
- Primary Topic
- Magnetic confinement fusion research
- Type
- article
- Field-Weighted Citation Impact
- 1.87
Funders
- U.S. Department of Energy
- Office of Science
- Advanced Scientific Computing Research