Consist: Provenance-Aware Caching and Queryable Provenance for Scientific Workflows

Consist is a caching and provenance layer for scientific simulationworkflows. It records the code, configuration, input data, and output artifactsbehind each run so expensive steps can be skipped safely and results remainqueryable after the fact. Consist is useful when a workflow has: - long-running model steps that should cache-hit when inputs are unchanged;- scenario variants that need explicit lineage and comparison;- file-based tools that need stable local paths but still need canonical provenance;- post-run questions like "which config produced this output?"

Authors

Institutions

Publication Details

Journal
The Journal of Open Source Software
Published
2026-10-27
DOI
https://doi.org/10.21105/joss.11131
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Consist: Provenance-Aware Caching and Queryable Provenance for Scientific Workflows

Zachary A. Needell
The Journal of Open Source Software
Scientific Computing and Data Management
article

Consist: Provenance-Aware Caching and Queryable Provenance for Scientific Workflows

Zachary A. Needell
article en

Abstract

Consist is a caching and provenance layer for scientific simulationworkflows. It records the code, configuration, input data, and output artifactsbehind each run so expensive steps can be skipped safely and results remainqueryable after the fact. Consist is useful when a workflow has: - long-running model steps that should cache-hit when inputs are unchanged;- scenario variants that need explicit lineage and comparison;- file-based tools that need stable local paths but still need canonical provenance;- post-run questions like "which config produced this output?"

The Journal of Open Source SoftwareVol. 11(126)
Lawrence Berkeley National Laboratory (US)
Openalex Percentile: Top 32%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon