Modernising Australian geophysics datasets to enable Nationalscale multiphysics computation at Exascale: one size can no longer fit all.

Although available computational power has increased significantly in the last decade, the geophysics community has been slow to utilise the latest High Performance Computing (HPC) resources. The 2030 Geophysics Collections Project, a collaboration between the National Computational Infrastructure (NCI), AuScope, Australian Research Data Commons (ARDC) and Terrestrial Ecosystem Research Network (TERN), investigated what was required to make existing Australian geophysical data collections compliant with the FAIR Principles, and openly accessible on existing HPC resources at NCI, and ultimately scaling to Exascale resources by 2030. A selection of AuScope-funded time series datasets in Magnetotellurics (MT), Passive Seismic (PS) and Distributed Acoustic Sensing (DAS) were ingested and organised on NCI's Gadi Tier 1 supercomputer to facilitate multi-physics (re)processing, modelling and analysis at scale. For MT, optimisation for HPC required reformatting datasets into the new MTH5/ mt_metadata standard, with benchmark processing showing that generating different MT processing levels for entire surveys can now be done transparently and in a matter of minutes utilising current HPC capability. In parallel to these data activities, the NCI-geophysics and NCI-AI-ML software environments were developed to enable a seamless experience for geophysical data analysis, processing and modelling on HPC and to help lower the barrier to entry for geophysical researchers wanting to perform AI/ML analysis utilising Gadi GPU resources. The 2030 Geophysics Collections Project showed that to realise the full value of significant investments going back over 50 years in acquiring continental-scale geophysical datasets in government, industry and academia, we need to consider a collaborative effort from all three sectors to remaster our current geophysical assets into modern HPC-compatible, self-describing formats suitable for in-situ processing to enable high-resolution processing at scale, and readiness for new computational techniques. However, there is still a need to make datasets accessible in current formats: and hence one size can no longer fit all.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-10-11
DOI
https://doi.org/10.5281/zenodo.13918350
Primary Topic
Seismic Waves and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Modernising Australian geophysics datasets to enable Nationalscale multiphysics computation at Exascale: one size can no longer fit all.

Zenodo (CERN European Organization for Nuclear Research)
Seismic Waves and Analysis
article

Modernising Australian geophysics datasets to enable Nationalscale multiphysics computation at Exascale: one size can no longer fit all.

article en

Abstract

Although available computational power has increased significantly in the last decade, the geophysics community has been slow to utilise the latest High Performance Computing (HPC) resources. The 2030 Geophysics Collections Project, a collaboration between the National Computational Infrastructure (NCI), AuScope, Australian Research Data Commons (ARDC) and Terrestrial Ecosystem Research Network (TERN), investigated what was required to make existing Australian geophysical data collections compliant with the FAIR Principles, and openly accessible on existing HPC resources at NCI, and ultimately scaling to Exascale resources by 2030. A selection of AuScope-funded time series datasets in Magnetotellurics (MT), Passive Seismic (PS) and Distributed Acoustic Sensing (DAS) were ingested and organised on NCI's Gadi Tier 1 supercomputer to facilitate multi-physics (re)processing, modelling and analysis at scale. For MT, optimisation for HPC required reformatting datasets into the new MTH5/ mt_metadata standard, with benchmark processing showing that generating different MT processing levels for entire surveys can now be done transparently and in a matter of minutes utilising current HPC capability. In parallel to these data activities, the NCI-geophysics and NCI-AI-ML software environments were developed to enable a seamless experience for geophysical data analysis, processing and modelling on HPC and to help lower the barrier to entry for geophysical researchers wanting to perform AI/ML analysis utilising Gadi GPU resources. The 2030 Geophysics Collections Project showed that to realise the full value of significant investments going back over 50 years in acquiring continental-scale geophysical datasets in government, industry and academia, we need to consider a collaborative effort from all three sectors to remaster our current geophysical assets into modern HPC-compatible, self-describing formats suitable for in-situ processing to enable high-resolution processing at scale, and readiness for new computational techniques. However, there is still a need to make datasets accessible in current formats: and hence one size can no longer fit all.

Zenodo (CERN European Organization for Nuclear Research)
Australian National University (AU), The University of Melbourne (AU), AuScope (AU)
Industry, innovation and infrastructure
Openalex Percentile: Top 69%
Seismic Waves and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.