Neural networks as a lossy compression and restart/recovery strategy for high-dimensional plasma simulations

High-resolution simulations, such as those of plasma dynamics in the Earth's magnetosphere, generate vast amounts of data that challenge storage and processing capabilities, especially in the Exascale computing era. Managing these data volumes requires innovative solutions that balance compression efficiency with the accuracy required for scientific analysis. In this work, we present a novel approach for lossy runtime data compression tailored for high-dimensional velocity distribution functions (VDFs) using the Vlasiator code. Our method integrates implicit neural representations, specifically Multi-Layer Perceptrons (MLPs), to train on and compress VDFs dynamically during the simulation runtime. We address the challenges of preserving physical correctness while achieving high compression ratios by employing techniques such as Fourier feature encoding and sinusoidal activation functions to mitigate spectral bias. We compare our method with industry-standard methods such as ZFP and demonstrate significant improvements in compression efficiency without compromising physical correctness.

Authors

Institutions

Publication Details

Journal
Physics of Plasmas
Published
2025-11-01
DOI
https://doi.org/10.1063/5.0280226
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Neural networks as a lossy compression and restart/recovery strategy for high-dimensional plasma simulations

Markku Alho, Minna Palmroth, Ioanna Bouri, J. Heikonen et al.
Physics of Plasmas
Advanced Data Storage Technologies
article

Neural networks as a lossy compression and restart/recovery strategy for high-dimensional plasma simulations

Markku Alho, Minna Palmroth, Ioanna Bouri, J. Heikonen, A. Kit, Konstantinos Papadakis, Juhani Kataja
article en

Abstract

High-resolution simulations, such as those of plasma dynamics in the Earth's magnetosphere, generate vast amounts of data that challenge storage and processing capabilities, especially in the Exascale computing era. Managing these data volumes requires innovative solutions that balance compression efficiency with the accuracy required for scientific analysis. In this work, we present a novel approach for lossy runtime data compression tailored for high-dimensional velocity distribution functions (VDFs) using the Vlasiator code. Our method integrates implicit neural representations, specifically Multi-Layer Perceptrons (MLPs), to train on and compress VDFs dynamically during the simulation runtime. We address the challenges of preserving physical correctness while achieving high compression ratios by employing techniques such as Fourier feature encoding and sinusoidal activation functions to mitigate spectral bias. We compare our method with industry-standard methods such as ZFP and demonstrate significant improvements in compression efficiency without compromising physical correctness.

Physics of PlasmasVol. 32(11)
Finnish Meteorological Institute (FI), Helsinki Institute of Physics (FI), CSC - IT Center for Science (Finland) (FI), VTT Technical Research Centre of Finland (FI)
Openalex Percentile: Top 59%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.