Segment Anything for Microscopy 2

Foundation models have advanced microscopy image segmentation, but existing models are trained on two-dimensional data, struggle with complex structures in volumetric data, and address only a narrow range of analysis tasks. Here we present Segment Anything for Microscopy 2 (μSAM2), a foundation model that adapts SAM2 to joint 2D and 3D segmentation in light and electron microscopy. Trained on annotations of more than 23 million cells and nuclei and 1.6 million cellular structures, μSAM2 achieves state-of-the-art automatic and interactive segmentation and outperforms generalist and specialist methods on volumetric data. Dedicated models further enable accurate mitochondrion and nucleus segmentation in electron microscopy. Beyond segmentation, μSAM2 supports pixel and object classification from few annotations as well as cell tracking in 2D and 3D time-lapse data. All functionality is available in the user-friendly μSAM napari plugin. We demonstrated the capabilities of μSAM2 on challenging use cases spanning developmental biology, organoid research, cardiac physiology, and histopathology.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-17
DOI
https://doi.org/10.64898/2026.11.12.766082
Primary Topic
Cell Image Analysis Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Segment Anything for Microscopy 2

Mostafa Aakhte, Mette Handberg-Thorsager, Jan Huisken, Constantin Pape et al.
2 links
bioRxiv (Cold Spring Harbor Laboratory)
Cell Image Analysis Techniques
preprint

Segment Anything for Microscopy 2

Mostafa Aakhte, Mette Handberg-Thorsager, Jan Huisken, Constantin Pape, Dominic Gruen, Anne Béghin, Isabelle Bonne, Nadine Vornberger, Anwai Archit, Lisa Marschhäuser, Carolin Teuber, Sebastian von Haaren, Beke Lohmann, Titus Griebel
preprint en

Abstract

Foundation models have advanced microscopy image segmentation, but existing models are trained on two-dimensional data, struggle with complex structures in volumetric data, and address only a narrow range of analysis tasks. Here we present Segment Anything for Microscopy 2 (μSAM2), a foundation model that adapts SAM2 to joint 2D and 3D segmentation in light and electron microscopy. Trained on annotations of more than 23 million cells and nuclei and 1.6 million cellular structures, μSAM2 achieves state-of-the-art automatic and interactive segmentation and outperforms generalist and specialist methods on volumetric data. Dedicated models further enable accurate mitochondrion and nucleus segmentation in electron microscopy. Beyond segmentation, μSAM2 supports pixel and object classification from few annotations as well as cell tracking in 2D and 3D time-lapse data. All functionality is available in the user-friendly μSAM napari plugin. We demonstrated the capabilities of μSAM2 on challenging use cases spanning developmental biology, organoid research, cardiac physiology, and histopathology.

bioRxiv (Cold Spring Harbor Laboratory)
National University of Singapore (SG), University of Würzburg (DE), UNSW Sydney (AU), Universitätsmedizin Göttingen (DE), Max Planck Institute for Multidisciplinary Sciences (DE), CAIMed - Niedersächsisches Zentrum für KI und Kausale Methoden in der Medizin (DE), University of Göttingen (DE)
Cell Image Analysis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon