A realistic phantom dataset for benchmarking cryo-ET data annotation

Cryo-electron tomography (cryo-ET) is a powerful technique for imaging molecular complexes in their native cellular environments. However, identifying the vast majority of molecular species in cellular tomograms remains prohibitively difficult. Machine learning (ML) methods provide an opportunity to automate the annotation process, but algorithm development has been hindered by the lack of large, standardized datasets. Here we present an experimental phantom dataset with comprehensive ground-truth annotations for six molecular species to spur new algorithm development and benchmark existing tools. This annotated dataset is available on the CryoET Data Portal with infrastructure to streamline access for methods developers across fields.

Authors

Institutions

Publication Details

Journal
Nature Methods
Published
2025-08-26
DOI
https://doi.org/10.1038/s41592-025-02800-5
Citations
2
Primary Topic
Advanced Electron Microscopy Techniques and Applications
Type
article
Field-Weighted Citation Impact
5.10

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A realistic phantom dataset for benchmarking cryo-ET data annotation

Mohammadreza Paraan, Joshua Hutchings, Bridget Carragher, Zhuowen Zhao et al.
2 citations
Nature Methods
Advanced Electron Microscopy Techniques and Applications
5.10
article

A realistic phantom dataset for benchmarking cryo-ET data annotation

Mohammadreza Paraan, Joshua Hutchings, Bridget Carragher, Zhuowen Zhao, Dari Kimanius, Yue Yu, Anchi Cheng, Clinton S. Potter, Saugat Kandel, Shawn Zheng, Matthias Haury, Utz H. Ermel, Elizabeth Montabana, Kyle Harrington, Ariana Peck, David A. Agard, Daniel Serwas, Hannah Siems, Feng Wang, Jonathan Schwartz
article en
2 citations

Abstract

Cryo-electron tomography (cryo-ET) is a powerful technique for imaging molecular complexes in their native cellular environments. However, identifying the vast majority of molecular species in cellular tomograms remains prohibitively difficult. Machine learning (ML) methods provide an opportunity to automate the annotation process, but algorithm development has been hindered by the lack of large, standardized datasets. Here we present an experimental phantom dataset with comprehensive ground-truth annotations for six molecular species to spur new algorithm development and benchmark existing tools. This annotated dataset is available on the CryoET Data Portal with infrastructure to streamline access for methods developers across fields.

Nature MethodsVol. 22(9)
University of California, San Francisco (US), Chan Zuckerberg Initiative (United States) (US)
Genentech, University of California, San Francisco
Openalex Percentile: Top 6%
Advanced Electron Microscopy Techniques and Applications
5.10
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.