Novel concept-oriented synthetic data approach for training generative AI-Driven crystal grain analysis using diffusion model

• Concept-oriented synthetic data method is illustrated to tackle the challenge of data scarcity. • Any required set of training data can be created from a set of concepts. • Method was used to train models to extract microstructure from microscopy images. • The framework integrates edge detection algorithms with generative machine learning diffusion models . • Trained model effectively identifies grain boundaries with accuracy of 97.23%. The traditional techniques for extracting polycrystalline grain structures from microscopy images, such as transmission electron microscopy (TEM) and scanning electron microscopy (SEM), are labour-intensive, subjective, and time-consuming, limiting their scalability for high-throughput analysis. In this study, we present an automated methodology integrating edge detection with generative diffusion models to effectively identify grains, eliminate noise, and connect broken segments in alignment with predicted grain boundaries. Due to the limited availability of adequate images preventing the training of deep machine learning models, a new seven-stage methodology is employed to generate synthetic TEM images for training. This concept-oriented synthetic data approach can be extended to any field of interest where the scarcity of data is a challenge. The presented model was applied to various metals with average grain sizes down to the nanoscale, producing grain morphologies from low-resolution TEM images that are comparable to those obtained from advanced and demanding experimental techniques with an average accuracy of 97.23 %. This represents a notable improvement, surpassing the accuracy of some of the state-of-the-art software-based methods for automated microstructure extraction, including neural network with convex hull and approximate contour (UNet + CHAC) (89 %), richer convolutional features (RCF) (91 %), and richer convolutional features with generative adversarial network (RCF + GAN) (93 %).

Authors

Institutions

Publication Details

Journal
Computational Materials Science
Published
2025-02-06
DOI
https://doi.org/10.1016/j.commatsci.2025.113723
Citations
2
Primary Topic
Mineral Processing and Grinding
Type
article
Field-Weighted Citation Impact
1.43

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Novel concept-oriented synthetic data approach for training generative AI-Driven crystal grain analysis using diffusion model

Isabelle D. Wolf, H. Ceric, Houman Zahedmanesh, Kristof Croes et al.
2 citations
Computational Materials Science
Mineral Processing and Grinding
1.43
article

Novel concept-oriented synthetic data approach for training generative AI-Driven crystal grain analysis using diffusion model

Isabelle D. Wolf, H. Ceric, Houman Zahedmanesh, Kristof Croes, A. S. Saleh
article en
2 citations

Abstract

• Concept-oriented synthetic data method is illustrated to tackle the challenge of data scarcity. • Any required set of training data can be created from a set of concepts. • Method was used to train models to extract microstructure from microscopy images. • The framework integrates edge detection algorithms with generative machine learning diffusion models . • Trained model effectively identifies grain boundaries with accuracy of 97.23%. The traditional techniques for extracting polycrystalline grain structures from microscopy images, such as transmission electron microscopy (TEM) and scanning electron microscopy (SEM), are labour-intensive, subjective, and time-consuming, limiting their scalability for high-throughput analysis. In this study, we present an automated methodology integrating edge detection with generative diffusion models to effectively identify grains, eliminate noise, and connect broken segments in alignment with predicted grain boundaries. Due to the limited availability of adequate images preventing the training of deep machine learning models, a new seven-stage methodology is employed to generate synthetic TEM images for training. This concept-oriented synthetic data approach can be extended to any field of interest where the scarcity of data is a challenge. The presented model was applied to various metals with average grain sizes down to the nanoscale, producing grain morphologies from low-resolution TEM images that are comparable to those obtained from advanced and demanding experimental techniques with an average accuracy of 97.23 %. This represents a notable improvement, surpassing the accuracy of some of the state-of-the-art software-based methods for automated microstructure extraction, including neural network with convex hull and approximate contour (UNet + CHAC) (89 %), richer convolutional features (RCF) (91 %), and richer convolutional features with generative adversarial network (RCF + GAN) (93 %).

Computational Materials ScienceVol. 251
TU Wien (AT), IMEC (BE), VIB-KU Leuven Center for Microbiology (BE), KU Leuven (BE)
European Commission, Vlaamse regering, HORIZON EUROPE Framework Programme
Zero hunger
Openalex Percentile: Top 23%
Mineral Processing and Grinding
1.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.