A Systematic Benchmark of Multifidelity Training Strategies for Reactive Machine Learning Potentials

Abstract Training reactive machine learning potentials (MLPs) requires extensive quantum chemical labeling of nonequilibrium configurations along reaction pathways, motivating the use of data from lower levels of theory through pretraining and Δ-learning. However, whether combining these strategies consistently improves accuracy and downstream performance remains unclear. Here, we benchmark direct and residual training, each with and without pretraining, across DPA-2, DPA-3, MACE, and DPA4-Neo, using 17.6 million configurations labeled with GFN2-xTB and 198,622 configurations labeled at the ωB97X-D/def2-TZVP level. With the full DFT training set, pretrained Δ-learning achieves the lowest energy or force MAE averaged over three training seeds in 31 of 32 combinations of architecture, data set, and property. Learning curves for DPA4-Neo nevertheless show that direct finetuning reaches the MAE of a model trained from scratch on the full data set using no more DFT training configurations than pretrained Δ-learning in all eight combinations of data set and property, while avoiding repeated GFN2-xTB evaluations during inference. Pretrained Δ-learning also improves reaction energies and forward barriers across all four architectures on GDB-10-rxn and reduces median Hessian eigenvalue errors for the evaluated DPA4-Neo checkpoint. However, local force errors can remain incompletely corrected, and these improvements do not consistently increase the success rates of reaction search workflows initialized from specified reactant and product geometries, indicating that the preferred protocol depends on the data budget, target property, and downstream workflow.

Authors

Institutions

Publication Details

Journal
Journal of Chemical Theory and Computation
Published
2026-11-11
DOI
https://doi.org/10.1021/acs.jctc.6c01789
Primary Topic
Machine Learning in Materials Science
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Systematic Benchmark of Multifidelity Training Strategies for Reactive Machine Learning Potentials

Tong Zhu, Bowen Li, Handong Wang, Shuwen Zhang et al.
Journal of Chemical Theory and Computation
Machine Learning in Materials Science
article

A Systematic Benchmark of Multifidelity Training Strategies for Reactive Machine Learning Potentials

Tong Zhu, Bowen Li, Handong Wang, Shuwen Zhang, John Z. H. Zhang, Sixuan Mi, Jiabin Yin, Jin Xiao, Duo Zhang
article en

Abstract

Abstract Training reactive machine learning potentials (MLPs) requires extensive quantum chemical labeling of nonequilibrium configurations along reaction pathways, motivating the use of data from lower levels of theory through pretraining and Δ-learning. However, whether combining these strategies consistently improves accuracy and downstream performance remains unclear. Here, we benchmark direct and residual training, each with and without pretraining, across DPA-2, DPA-3, MACE, and DPA4-Neo, using 17.6 million configurations labeled with GFN2-xTB and 198,622 configurations labeled at the ωB97X-D/def2-TZVP level. With the full DFT training set, pretrained Δ-learning achieves the lowest energy or force MAE averaged over three training seeds in 31 of 32 combinations of architecture, data set, and property. Learning curves for DPA4-Neo nevertheless show that direct finetuning reaches the MAE of a model trained from scratch on the full data set using no more DFT training configurations than pretrained Δ-learning in all eight combinations of data set and property, while avoiding repeated GFN2-xTB evaluations during inference. Pretrained Δ-learning also improves reaction energies and forward barriers across all four architectures on GDB-10-rxn and reduces median Hessian eigenvalue errors for the evaluated DPA4-Neo checkpoint. However, local force errors can remain incompletely corrected, and these improvements do not consistently increase the success rates of reaction search workflows initialized from specified reactant and product geometries, indicating that the preferred protocol depends on the data budget, target property, and downstream workflow.

Journal of Chemical Theory and Computation
Chinese Academy of Sciences (CN), New York University Shanghai (CN), Shenzhen Institutes of Advanced Technology (CN), Shenzhen University of Advanced Technology (CN), Shanghai Innovation Institute (CN), New York University (US), East China Normal University (CN)
Machine Learning in Materials Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon