Zero-Shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials

Characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training. Even for trained human operators, accurate and reliable characterization remains challenging when examining newly discovered materials such as two-dimensional (2D) structures. This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training data sets. In this work, we present ATOMIC (Autonomous Technology for Optical Microscopy & Intelligent Characterization), an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials. Our system integrates the vision foundation model (i.e., Segment Anything Model), large language models (i.e., ChatGPT), unsupervised clustering, and topological analysis to automate microscope control, sample scanning, image segmentation, and intelligent analysis through prompt engineering, eliminating the need for additional training. When analyzing typical MoS<sub>2</sub> samples, our approach achieves 99.7% segmentation accuracy for single layer identification, which is equivalent to that of human experts. In addition, the integrated model is able to detect grain boundary slits that are challenging to identify with human eyes. Furthermore, the system retains robust accuracy despite variable conditions, including defocus, color-temperature fluctuations, and exposure variations. It is applicable to a broad spectrum of common 2D materials─including graphene, MoS<sub>2</sub>, WSe<sub>2</sub>, SnSe─regardless of whether they were fabricated via top-down or bottom-up methods. This work represents the implementation of foundation models to achieve autonomous analysis, providing a scalable and data-efficient characterization paradigm that transforms the approach to nanoscale materials research.

Authors

Institutions

Publication Details

Journal
ACS Nano
Published
2025-10-02
DOI
https://doi.org/10.1021/acsnano.5c09057
Citations
1
Primary Topic
Machine Learning in Materials Science
Type
article
Field-Weighted Citation Impact
0.52
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Zero-Shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials

S. Ananda Kumar, Zhichu Ren, Xinghuan Wang, Neil Zhenqiang Gong et al.
1 citations
ACS Nano
Machine Learning in Materials Science
0.52
article

Zero-Shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials

S. Ananda Kumar, Zhichu Ren, Xinghuan Wang, Neil Zhenqiang Gong, Chi Jiang, Keran Rong, Aaron D. Franklin, Ruoyu Yin, Haoning Tang, Xingjian Hu, Haozhe Wang, Yuepeng Hu, Xiaohua Zhai, Zongyou Yin, Jing Kong, Yaguang Zhu, H. J. Yang, Tianyi Zhang, Xiaokai Zhu, Yuan Cao, Samantha K. Holmes
article en
1 citations

Abstract

Characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training. Even for trained human operators, accurate and reliable characterization remains challenging when examining newly discovered materials such as two-dimensional (2D) structures. This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training data sets. In this work, we present ATOMIC (Autonomous Technology for Optical Microscopy & Intelligent Characterization), an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials. Our system integrates the vision foundation model (i.e., Segment Anything Model), large language models (i.e., ChatGPT), unsupervised clustering, and topological analysis to automate microscope control, sample scanning, image segmentation, and intelligent analysis through prompt engineering, eliminating the need for additional training. When analyzing typical MoS<sub>2</sub> samples, our approach achieves 99.7% segmentation accuracy for single layer identification, which is equivalent to that of human experts. In addition, the integrated model is able to detect grain boundary slits that are challenging to identify with human eyes. Furthermore, the system retains robust accuracy despite variable conditions, including defocus, color-temperature fluctuations, and exposure variations. It is applicable to a broad spectrum of common 2D materials─including graphene, MoS<sub>2</sub>, WSe<sub>2</sub>, SnSe─regardless of whether they were fabricated via top-down or bottom-up methods. This work represents the implementation of foundation models to achieve autonomous analysis, providing a scalable and data-efficient characterization paradigm that transforms the approach to nanoscale materials research.

ACS NanoVol. 19(40)
Australian National University (AU), Google (United States) (US), National University of Singapore (SG), Duke University (US), Google DeepMind (United Kingdom) (GB), Massachusetts Institute of Technology (US), University of California, Berkeley (US)
Openalex Percentile: Top 32%
Machine Learning in Materials Science
0.52
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.