Neural networks as a lossy compression and restart/recovery strategy for high-dimensional plasma simulations
High-resolution simulations, such as those of plasma dynamics in the Earth's magnetosphere, generate vast amounts of data that challenge storage and processing capabilities, especially in the Exascale computing era. Managing these data volumes requires innovative solutions that balance compression efficiency with the accuracy required for scientific analysis. In this work, we present a novel approach for lossy runtime data compression tailored for high-dimensional velocity distribution functions (VDFs) using the Vlasiator code. Our method integrates implicit neural representations, specifically Multi-Layer Perceptrons (MLPs), to train on and compress VDFs dynamically during the simulation runtime. We address the challenges of preserving physical correctness while achieving high compression ratios by employing techniques such as Fourier feature encoding and sinusoidal activation functions to mitigate spectral bias. We compare our method with industry-standard methods such as ZFP and demonstrate significant improvements in compression efficiency without compromising physical correctness.
Authors
- Markku Alho (ORCID: https://orcid.org/0000-0001-9762-6795)
- Minna Palmroth (ORCID: https://orcid.org/0000-0003-4857-1227)
- Ioanna Bouri (ORCID: https://orcid.org/0009-0002-6807-2951)
- J. Heikonen (ORCID: https://orcid.org/0009-0000-7466-6698)
- A. Kit (ORCID: https://orcid.org/0000-0003-2621-6291)
- Konstantinos Papadakis (ORCID: https://orcid.org/0000-0002-3307-6015)
- Juhani Kataja (ORCID: https://orcid.org/0000-0002-1212-0080)
Institutions
- Finnish Meteorological Institute (FI)
- Helsinki Institute of Physics (FI)
- CSC - IT Center for Science (Finland) (FI)
- VTT Technical Research Centre of Finland (FI)
Publication Details
- Journal
- Physics of Plasmas
- Published
- 2025-11-01
- DOI
- https://doi.org/10.1063/5.0280226
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00