STEMDiff: A Wavelet‐Enhanced Diffusion Model for Physics‐Informed STEM Image Generation

Machine learning has emerged as a powerful tool for analyzing scanning transmission electron microscopy (STEM) images, yet its widespread application remains constrained by the scarcity of annotated training data. While deep generative models offer a promising solution, they typically struggle to reproduce the complex high-frequency components that define experimental STEM images. Here, STEMDiff, a conditional diffusion model that transforms simple binary labels derived from crystal structures into realistic STEM images through a physical information embedding strategy, is proposed. By developing a novel Discrete Wavelet Transform-based skip-connection architecture, the high-frequency bias inherent in diffusion models are addressed, enabling the preservation of experimental noise characteristics. This approach generates images that are quantitatively nearly indistinguishable from experimental data (17 fold improvement over previous methods) while retaining ground truth structural information. Fully convolutional networks trained exclusively on these synthetic images achieve high-precision atomic column detection in experimental STEM images of WSe<sub>2</sub> and graphene, despite the presence of substantial background noise and contamination. This approach effectively eliminates the need for laborious manual annotation, providing a scalable solution to the data bottleneck in STEM image analysis. The principles underlying STEMDiff can extend to other scientific imaging modalities, accelerating advancements in materials design for water treatment.

Authors

Institutions

Publication Details

Journal
Advanced Science
Published
2025-09-27
DOI
https://doi.org/10.1002/advs.202508266
Citations
1
Primary Topic
Advanced Electron Microscopy Techniques and Applications
Type
article
Field-Weighted Citation Impact
2.55

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

STEMDiff: A Wavelet‐Enhanced Diffusion Model for Physics‐Informed STEM Image Generation

Houyang Chen, Xinyi Lu, Yihui Bao, Zhencheng Ye et al.
1 citations
Advanced Science
Advanced Electron Microscopy Techniques and Applications
2.55
article

STEMDiff: A Wavelet‐Enhanced Diffusion Model for Physics‐Informed STEM Image Generation

Houyang Chen, Xinyi Lu, Yihui Bao, Zhencheng Ye, Yanyan Xia
article en
1 citations

Abstract

Machine learning has emerged as a powerful tool for analyzing scanning transmission electron microscopy (STEM) images, yet its widespread application remains constrained by the scarcity of annotated training data. While deep generative models offer a promising solution, they typically struggle to reproduce the complex high-frequency components that define experimental STEM images. Here, STEMDiff, a conditional diffusion model that transforms simple binary labels derived from crystal structures into realistic STEM images through a physical information embedding strategy, is proposed. By developing a novel Discrete Wavelet Transform-based skip-connection architecture, the high-frequency bias inherent in diffusion models are addressed, enabling the preservation of experimental noise characteristics. This approach generates images that are quantitatively nearly indistinguishable from experimental data (17 fold improvement over previous methods) while retaining ground truth structural information. Fully convolutional networks trained exclusively on these synthetic images achieve high-precision atomic column detection in experimental STEM images of WSe<sub>2</sub> and graphene, despite the presence of substantial background noise and contamination. This approach effectively eliminates the need for laborious manual annotation, providing a scalable solution to the data bottleneck in STEM image analysis. The principles underlying STEMDiff can extend to other scientific imaging modalities, accelerating advancements in materials design for water treatment.

Advanced ScienceVol. 12(41)
East China University of Science and Technology (CN), Chongqing University (CN), Chongqing Institute of Green and Intelligent Technology (CN), University of Chinese Academy of Sciences (CN)
National Natural Science Foundation of China, Chinese Academy of Sciences, Natural Science Foundation of Chongqing, Centre Scientifique et Technique du Bâtiment, National Key Research and Development Program of China, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences
Openalex Percentile: Top 9%
Advanced Electron Microscopy Techniques and Applications
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.