STEMDiff: A Wavelet‐Enhanced Diffusion Model for Physics‐Informed STEM Image Generation
Machine learning has emerged as a powerful tool for analyzing scanning transmission electron microscopy (STEM) images, yet its widespread application remains constrained by the scarcity of annotated training data. While deep generative models offer a promising solution, they typically struggle to reproduce the complex high-frequency components that define experimental STEM images. Here, STEMDiff, a conditional diffusion model that transforms simple binary labels derived from crystal structures into realistic STEM images through a physical information embedding strategy, is proposed. By developing a novel Discrete Wavelet Transform-based skip-connection architecture, the high-frequency bias inherent in diffusion models are addressed, enabling the preservation of experimental noise characteristics. This approach generates images that are quantitatively nearly indistinguishable from experimental data (17 fold improvement over previous methods) while retaining ground truth structural information. Fully convolutional networks trained exclusively on these synthetic images achieve high-precision atomic column detection in experimental STEM images of WSe<sub>2</sub> and graphene, despite the presence of substantial background noise and contamination. This approach effectively eliminates the need for laborious manual annotation, providing a scalable solution to the data bottleneck in STEM image analysis. The principles underlying STEMDiff can extend to other scientific imaging modalities, accelerating advancements in materials design for water treatment.
Authors
- Houyang Chen (ORCID: https://orcid.org/0000-0002-3319-5743)
- Xinyi Lu (ORCID: https://orcid.org/0000-0001-9379-4935)
- Yihui Bao
- Zhencheng Ye
- Yanyan Xia
Institutions
- East China University of Science and Technology (CN)
- Chongqing University (CN)
- Chongqing Institute of Green and Intelligent Technology (CN)
- University of Chinese Academy of Sciences (CN)
Publication Details
- Journal
- Advanced Science
- Published
- 2025-09-27
- DOI
- https://doi.org/10.1002/advs.202508266
- Citations
- 1
- Primary Topic
- Advanced Electron Microscopy Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 2.55
Funders
- National Natural Science Foundation of China
- Chinese Academy of Sciences
- Natural Science Foundation of Chongqing
- Centre Scientifique et Technique du Bâtiment
- National Key Research and Development Program of China
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences