Hybrid physics-machine learning models for quantitative electron diffraction refinements

High accuracy electron microscopy simulations required for quantitative crystal structure refinements face a fundamental challenge: while physical interactions are well-described theoretically, real-world experimental effects are challenging to model analytically. To address this gap, we present a hybrid physics-machine learning framework that integrates differentiable physical simulations with neural networks. By leveraging automatic differentiation throughout the simulation pipeline, our method enables gradient-based joint optimization of physical parameters and neural network components representing experimental variables, offering superior scalability compared to traditional second-order methods. We demonstrate this framework through application to three-dimensional electron diffraction (3D-ED) structure refinement, where our approach learns complex thickness distributions directly from diffraction data rather than relying on simplified geometric models. This method achieves state-of-the-art refinement performance across synthetic and experimental datasets, recovering atomic positions, thermal displacements, and thickness profiles with high fidelity. The modular architecture proposed can naturally be extended to accommodate additional physical phenomena and extended to other electron microscopy techniques. This establishes differentiable hybrid modeling as a powerful paradigm for quantitative electron microscopy, where experimental complexities have historically limited analysis.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2026-04-11
DOI
https://doi.org/10.1038/s41467-026-71673-9
Primary Topic
Electron and X-Ray Spectroscopy Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid physics-machine learning models for quantitative electron diffraction refinements

Yarin Gal, Tiarnan A. S. Doherty, Paul Anthony Midgley, Stephen Roberts et al.
Nature Communications
Electron and X-Ray Spectroscopy Techniques
article

Hybrid physics-machine learning models for quantitative electron diffraction refinements

Yarin Gal, Tiarnan A. S. Doherty, Paul Anthony Midgley, Stephen Roberts, Shreshth A. Malik, Benjamin Colmey
article en

Abstract

High accuracy electron microscopy simulations required for quantitative crystal structure refinements face a fundamental challenge: while physical interactions are well-described theoretically, real-world experimental effects are challenging to model analytically. To address this gap, we present a hybrid physics-machine learning framework that integrates differentiable physical simulations with neural networks. By leveraging automatic differentiation throughout the simulation pipeline, our method enables gradient-based joint optimization of physical parameters and neural network components representing experimental variables, offering superior scalability compared to traditional second-order methods. We demonstrate this framework through application to three-dimensional electron diffraction (3D-ED) structure refinement, where our approach learns complex thickness distributions directly from diffraction data rather than relying on simplified geometric models. This method achieves state-of-the-art refinement performance across synthetic and experimental datasets, recovering atomic positions, thermal displacements, and thickness profiles with high fidelity. The modular architecture proposed can naturally be extended to accommodate additional physical phenomena and extended to other electron microscopy techniques. This establishes differentiable hybrid modeling as a powerful paradigm for quantitative electron microscopy, where experimental complexities have historically limited analysis.

Nature Communications
University of Cambridge (GB), Oxford Research Group (GB), University of Oxford (GB), Science Oxford (GB)
Alan Turing Institute, Engineering and Physical Sciences Research Council
Openalex Percentile: Top 100%
Electron and X-Ray Spectroscopy Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.