Analysis-ready VCF at Biobank scale using Zarr

Large row-encoded VCF files are a major bottleneck for current research, and storing and processing these files incurs a substantial cost. The VCF Zarr specification, building on widely used, open-source technologies, has the potential to greatly reduce these costs, and may enable a diverse ecosystem of next-generation tools for analysing genetic variation data directly from cloud-based object stores, while maintaining compatibility with existing file-oriented workflows.

Authors

Institutions

Publication Details

Journal
GigaScience
Published
2025-01-01
DOI
https://doi.org/10.1093/gigascience/giaf049
Citations
3
Primary Topic
Genomics and Phylogenetic Studies
Type
article
Field-Weighted Citation Impact
2.42

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Analysis-ready VCF at Biobank scale using Zarr

Jeff Hammerbacher, Jerome Kelleher, Tom White, Jonny Hancox et al.
3 citations
GigaScience
Genomics and Phylogenetic Studies
2.42
article

Analysis-ready VCF at Biobank scale using Zarr

Jeff Hammerbacher, Jerome Kelleher, Tom White, Jonny Hancox, Per Unneberg, Eric Czech, Shadi Zabad, Ben Jeffery, Alistair Miles, Benjamin Elsworth, Timothy R. Millar, Sam Tallman, Rafal Wojdyla, Konrad J. Karczewski, Jérémy Guez, Will Tyler
article en
3 citations

Abstract

Large row-encoded VCF files are a major bottleneck for current research, and storing and processing these files incurs a substantial cost. The VCF Zarr specification, building on widely used, open-source technologies, has the potential to greatly reduce these costs, and may enable a diverse ecosystem of next-generation tools for analysing genetic variation data directly from cloud-based object stores, while maintaining compatibility with existing file-oriented workflows.

GigaScienceVol. 14
Broad Institute (US), Nvidia (United Kingdom) (GB), Plant & Food Research (NZ), Open Society Foundations (US), The George Institute for Global Health (GB), Science for Life Laboratory (SE), Ontario Genomics (CA), Wellcome Sanger Institute (GB), Morgan Stanley (United States) (US), University of Colorado Health (US), Massachusetts General Hospital (US), The White House (US), Genomics England (GB), McGill University (CA), University of Otago (NZ)
Bill and Melinda Gates Foundation, Knut och Alice Wallenbergs Stiftelse
Industry, innovation and infrastructure
Openalex Percentile: Top 11%
Genomics and Phylogenetic Studies
2.42
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.