Easy creation of reproducible computational workflows with SciWIn-Client

Computational workflows are used in many different disciplines to automate complex, multi-step data analysis procedures. To ensure reproducibility, scalability and efficiency in scientific research, lots of effort has been put into domain specific languages that formalize and standardize computational scientific work. The Common Workflow Language (CWL)[1] is among the most powerful and established workflow languages. While CWL is an extremely flexible language, is also quite verbose. To facilitate the creation of CWL files, SciWIn-Client, which is written in the Rust programming language, offers a simple command line interface. SciWIn-Client is the first building block of the Scientific Workflow Infrastructure which is a key part of the FAIRagro consortium's service portfolio. CWL workflows are structured as directed acyclic graphs where individual steps are connected through their inputs and outputs. A CWL CommandLineTool represents a single executable step in a workflow. A CWL Workflow acts as a container for multiple steps, connects multiple tools and manages dependencies between steps. SciWIn-Client creates CWL CommandLineTools by capturing and analyzing the CLI command-line used by the researcher in their usual routine to carry out computational tasks. Steps represented by CWL CommandLineTools can be connected into complex workflows by using simple commands to build the directed acyclic graph edge by edge. Designed as an unobtrusive lean CLI program, SciWIn-Client integrates seamlessly into the researcher's toolbox providing for provenance management what Git delivers for version control. SciWIn-Client thus helps to implement FAIR data- and code handling practices right at the digital workbench. Next to the reproducibility and traceability of computational processes, scientists gain the ability package their intermediate and final results into FAIR Digital Objects (FDOs). We develop multiple export options, including Workflow RO-Crates[2] that can be published on workflowhub.eu, ARCs[3] that are compatible with DataPLANT's PLANTdataHUB[3], and Provenance Run Crate[4] as the most advanced FDO type. Furthermore, the CWL workflows created by SciWIn-Client can be executed by remote execution engines such as Reana[5] and thus provide easy access to high performance compute infrastructure.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-08-04
DOI
https://doi.org/10.5281/zenodo.16735805
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Easy creation of reproducible computational workflows with SciWIn-Client

Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
article

Easy creation of reproducible computational workflows with SciWIn-Client

article en

Abstract

Computational workflows are used in many different disciplines to automate complex, multi-step data analysis procedures. To ensure reproducibility, scalability and efficiency in scientific research, lots of effort has been put into domain specific languages that formalize and standardize computational scientific work. The Common Workflow Language (CWL)[1] is among the most powerful and established workflow languages. While CWL is an extremely flexible language, is also quite verbose. To facilitate the creation of CWL files, SciWIn-Client, which is written in the Rust programming language, offers a simple command line interface. SciWIn-Client is the first building block of the Scientific Workflow Infrastructure which is a key part of the FAIRagro consortium's service portfolio. CWL workflows are structured as directed acyclic graphs where individual steps are connected through their inputs and outputs. A CWL CommandLineTool represents a single executable step in a workflow. A CWL Workflow acts as a container for multiple steps, connects multiple tools and manages dependencies between steps. SciWIn-Client creates CWL CommandLineTools by capturing and analyzing the CLI command-line used by the researcher in their usual routine to carry out computational tasks. Steps represented by CWL CommandLineTools can be connected into complex workflows by using simple commands to build the directed acyclic graph edge by edge. Designed as an unobtrusive lean CLI program, SciWIn-Client integrates seamlessly into the researcher's toolbox providing for provenance management what Git delivers for version control. SciWIn-Client thus helps to implement FAIR data- and code handling practices right at the digital workbench. Next to the reproducibility and traceability of computational processes, scientists gain the ability package their intermediate and final results into FAIR Digital Objects (FDOs). We develop multiple export options, including Workflow RO-Crates[2] that can be published on workflowhub.eu, ARCs[3] that are compatible with DataPLANT's PLANTdataHUB[3], and Provenance Run Crate[4] as the most advanced FDO type. Furthermore, the CWL workflows created by SciWIn-Client can be executed by remote execution engines such as Reana[5] and thus provide easy access to high performance compute infrastructure.

Zenodo (CERN European Organization for Nuclear Research)
Johann Heinrich von Thünen-Institut (DE), Leibniz-Institut für Pflanzengenetik und Kulturpflanzenforschung (IPK) (DE)
Industry, innovation and infrastructure
Openalex Percentile: Top 33%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.