Citizen Science Gamers Enable Automated Flow Cytometry Gating Through Machine Learning

Machine learning can greatly accelerate biomedical research but is fundamentally constrained by the scarcity of high-quality labeled data. We introduce a scalable data-generation framework based on citizen science and apply it to automated flow cytometry gating, a foundational but subjective step in immunology that limits reproducibility. Using the massively multiplayer online game EVE Online, 839,199 de-identified player accounts analyzed 52,000 plots, from which stringent quality control produced 31,703 consensus annotations for model training. Leveraging these data, we developed flowMagic, a machine learning framework for automated gating. Evaluated on 92,203 bivariate plots with standardized reference gates spanning 79 immune populations, the template model outperformed the generalized model, achieving 90% and 65% agreement for large and low-abundance populations, respectively, compared with 78% and 42% for the generalized model. These results show that expert-provided templates currently provide the highest agreement, while the citizen-science-trained generalized model enables gating without gate-specific templates but remains limited by the absence of expert-curated examples for complex, low-abundance or context-dependent gates. Both model types reproduced biologically meaningful patterns, including neutrophil dynamics in COVID-19 patients and immune development in newborns. Together, these results establish citizen-science annotation as a scalable strategy for generating training data that complements, rather than replaces, expert input in automated flow cytometry gating.

Authors

Institutions

Publication Details

Journal
Cytometry Part A
Published
2026-10-29
DOI
https://doi.org/10.1002/cyto.a.70074
Primary Topic
Cell Image Analysis Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Citizen Science Gamers Enable Automated Flow Cytometry Gating Through Machine Learning

Jérôme Waldispühl, Hjalti Leifsson, Alexander Butyaev, Ryan R. Brinkman et al.
1 links
Cytometry Part A
Cell Image Analysis Techniques
article

Citizen Science Gamers Enable Automated Flow Cytometry Gating Through Machine Learning

Jérôme Waldispühl, Hjalti Leifsson, Alexander Butyaev, Ryan R. Brinkman, Albina Rahim, Sebastiano Montante, Mehrnoush Malek, Quentin Michalchuk, Daniel Yokosawa, Attila Szantner, Bergur Finnbogason, W.P. River, Andrea Cossarizza, Kornél Erhart, David J. Ecker, Julia Boira Esteban, George Kelion, Razzi Movassaghi, David Shmil, Leon Li, Chieh‐Ting Jimmy Hsu
article en

Abstract

Machine learning can greatly accelerate biomedical research but is fundamentally constrained by the scarcity of high-quality labeled data. We introduce a scalable data-generation framework based on citizen science and apply it to automated flow cytometry gating, a foundational but subjective step in immunology that limits reproducibility. Using the massively multiplayer online game EVE Online, 839,199 de-identified player accounts analyzed 52,000 plots, from which stringent quality control produced 31,703 consensus annotations for model training. Leveraging these data, we developed flowMagic, a machine learning framework for automated gating. Evaluated on 92,203 bivariate plots with standardized reference gates spanning 79 immune populations, the template model outperformed the generalized model, achieving 90% and 65% agreement for large and low-abundance populations, respectively, compared with 78% and 42% for the generalized model. These results show that expert-provided templates currently provide the highest agreement, while the citizen-science-trained generalized model enables gating without gate-specific templates but remains limited by the absence of expert-curated examples for complex, low-abundance or context-dependent gates. Both model types reproduced biologically meaningful patterns, including neutrophil dynamics in COVID-19 patients and immune development in newborns. Together, these results establish citizen-science annotation as a scalable strategy for generating training data that complements, rather than replaces, expert input in automated flow cytometry gating.

Cytometry Part A
University of Modena and Reggio Emilia (IT), BC Cancer Agency (CA), Microsoft (United States) (US), University of British Columbia (CA), University of Exeter (GB), Surrey Memorial Hospital (CA), McGill University Health Centre (CA), McGill University (CA)
European Commission, Canada Research Chairs, Natural Sciences and Engineering Research Council of Canada
Openalex Percentile: Top 20%
Cell Image Analysis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon