A python workflow definition for computational materials design

Numerous Workflow Management Systems (WfMS) have been developed in the field of computational materials science with different workflow formats, hindering interoperability and reproducibility of workflows in the field. To address this challenge, we introduce here the Python Workflow Definition (PWD) as a workflow exchange format to share workflows between Python-based WfMS, currently AiiDA, jobflow, and pyiron. This development is motivated by the similarity of these three Python-based WfMS, that represent the different workflow steps and data transferred between them as nodes and edges in a graph. With the PWD, we aim at fostering the interoperability and reproducibility between the different WfMS in the context of Findable, Accessible, Interoperable, Reusable (FAIR) workflows. To separate the scientific from the technical complexity, the PWD consists of three components: (1) a conda environment that specifies the software dependencies, (2) a Python module that contains the Python functions represented as nodes in the workflow graph, and (3) a workflow graph stored in the JavaScript Object Notation (JSON). The first version of the PWD supports Directed Acyclic Graph (DAG)-based workflows. Thus, any DAG-based workflow defined in one of the three WfMS can be exported to the PWD and afterwards imported from the PWD to one of the other WfMS. After the import, the input parameters of the workflow can be adjusted and computing resources can be assigned to the workflow, before it is executed with the selected WfMS. This import from and export to the PWD is enabled by the PWD Python library that implements the PWD in AiiDA, jobflow, and pyiron.

Authors

Institutions

Publication Details

Journal
Digital Discovery
Published
2025-01-01
DOI
https://doi.org/10.1039/d5dd00231a
Citations
1
Primary Topic
Machine Learning in Materials Science
Type
article
Field-Weighted Citation Impact
0.52

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A python workflow definition for computational materials design

Xing Wang, Jan Janßen, Tilmann Hickel, Giovanni Pizzi et al.
1 citations
Digital Discovery
Machine Learning in Materials Science
0.52
article

A python workflow definition for computational materials design

Xing Wang, Jan Janßen, Tilmann Hickel, Giovanni Pizzi, Christina Ertural, Marnik Bercx, Jörg Neugebauer, Jörg Schaarschmidt, Julian Geiger, Alex M. Ganose, Janine George
article en
1 citations

Abstract

Numerous Workflow Management Systems (WfMS) have been developed in the field of computational materials science with different workflow formats, hindering interoperability and reproducibility of workflows in the field. To address this challenge, we introduce here the Python Workflow Definition (PWD) as a workflow exchange format to share workflows between Python-based WfMS, currently AiiDA, jobflow, and pyiron. This development is motivated by the similarity of these three Python-based WfMS, that represent the different workflow steps and data transferred between them as nodes and edges in a graph. With the PWD, we aim at fostering the interoperability and reproducibility between the different WfMS in the context of Findable, Accessible, Interoperable, Reusable (FAIR) workflows. To separate the scientific from the technical complexity, the PWD consists of three components: (1) a conda environment that specifies the software dependencies, (2) a Python module that contains the Python functions represented as nodes in the workflow graph, and (3) a workflow graph stored in the JavaScript Object Notation (JSON). The first version of the PWD supports Directed Acyclic Graph (DAG)-based workflows. Thus, any DAG-based workflow defined in one of the three WfMS can be exported to the PWD and afterwards imported from the PWD to one of the other WfMS. After the import, the input parameters of the workflow can be adjusted and computing resources can be assigned to the workflow, before it is executed with the selected WfMS. This import from and export to the PWD is enabled by the PWD Python library that implements the PWD in AiiDA, jobflow, and pyiron.

Digital DiscoveryVol. 4(11)
Karlsruhe Institute of Technology (DE), Federal Institute For Materials Research and Testing (DE), Paul Scherrer Institute (CH), Max-Planck-Institut für Nachhaltige Materialien (DE), Kerntechnische Entsorgung Karlsruhe (Germany) (DE), Imperial College London (GB), Friedrich Schiller University Jena (DE)
National Science Foundation, European Commission, Deutsche Forschungsgemeinschaft, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, Bundesministerium für Bildung und Forschung, Board of the Swiss Federal Institutes of Technology, Gauss Centre for Supercomputing, Leibniz-Gemeinschaft, Staatssekretariat für Bildung, Forschung und Innovation, National Center of Competence in Research Materials’ Revolution: Computational Design and Discovery of Novel Materials, Leibniz-Rechenzentrum
Openalex Percentile: Top 32%
Machine Learning in Materials Science
0.52
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.