Improving Machine Learning Frameworks for Catalyst Simulations

The looming threat of climate change is driving an urgent need to redesign industrial processes worldwide with new and more efficient catalysts. Machine learning methods have the potential to massively accelerate the discovery of novel catalysts, which are extremely costly and therefore slow to discover by traditional methods. Quantum mechanical simulators like Density Functional Theory (DFT) allow computational simulations to be used to discover new catalysts at great computational expense, which prevents large scale DFT efforts from meeting this demand. Graph Neural Networks (GNNs) have emerged as promising machine learned surrogates for DFT, with the capacity to achieve high accuracy when learning from DFT generated data and improve upon computational costs by up to O(10<sup>5</sup>). However, GNNs can suffer from challenges with consistency, performance, and generalization, and require improvements to be sufficient for the task at hand. This dissertation explores the development of improved machine learning frameworks for catalyst discovery in the areas of trustability, efficiency, and adaptability. First I present Finetuna, an open source package for ac celerating catalyst simulations and efficiently acquiring new data with active learning and fine tuning. Second I demonstrate the successes and pitfalls of using Finetuna as a transfer learning strategy to adapt pre-trained GNNs to out-of-distribution structures. Third I benchmark and develop novel im provements to uncertainty quantification methods for GNNs to intelligently identify when to trust the model and when it must be adapted. Finally I ex plore the usefulness of GNNs for determining the potential energy Hessian, an extremely high value task which is related to, but not explicitly repre sented in, its training data set.

Institutions

Publication Details

Journal
Figshare
Published
2025-01-01
DOI
https://doi.org/10.1184/r1/28755035.v1
Primary Topic
Machine Learning in Materials Science
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Machine Learning Frameworks for Catalyst Simulations

Figshare
Machine Learning in Materials Science
article

Improving Machine Learning Frameworks for Catalyst Simulations

article en

Abstract

The looming threat of climate change is driving an urgent need to redesign industrial processes worldwide with new and more efficient catalysts. Machine learning methods have the potential to massively accelerate the discovery of novel catalysts, which are extremely costly and therefore slow to discover by traditional methods. Quantum mechanical simulators like Density Functional Theory (DFT) allow computational simulations to be used to discover new catalysts at great computational expense, which prevents large scale DFT efforts from meeting this demand. Graph Neural Networks (GNNs) have emerged as promising machine learned surrogates for DFT, with the capacity to achieve high accuracy when learning from DFT generated data and improve upon computational costs by up to O(10<sup>5</sup>). However, GNNs can suffer from challenges with consistency, performance, and generalization, and require improvements to be sufficient for the task at hand. This dissertation explores the development of improved machine learning frameworks for catalyst discovery in the areas of trustability, efficiency, and adaptability. First I present Finetuna, an open source package for ac celerating catalyst simulations and efficiently acquiring new data with active learning and fine tuning. Second I demonstrate the successes and pitfalls of using Finetuna as a transfer learning strategy to adapt pre-trained GNNs to out-of-distribution structures. Third I benchmark and develop novel im provements to uncertainty quantification methods for GNNs to intelligently identify when to trust the model and when it must be adapted. Finally I ex plore the usefulness of GNNs for determining the potential energy Hessian, an extremely high value task which is related to, but not explicitly repre sented in, its training data set.

Figshare
Carnegie Mellon University (US)
Climate action
Openalex Percentile: Top 65%
Machine Learning in Materials Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.