Assessing the transfer-learning performance of foundation models for energetic materials property prediction under low-data conditions

This study evaluates the performance of off-the-shelf foundation model embeddings provided by CheMeleon, MolCLR, and MACE-OFF to predict energetic material properties from sparse datasets. Models were trained to predict crystal density, heat of formation and impact sensitivity from SMILES strings, with performance benchmarked against molecular representations provided by Morgan fingerprints and hand-crafted descriptors. Overall, the foundation model embeddings were found to be competitive with the hand-crafted descriptors, with MACE-OFF showing the strongest performance in numerical regression tasks. Heat of formation was found to be the most predictable property (R2 = 0.72), followed by crystal density (R2 = 0.54) and impact sensitivity (R2 = 0.47). Testing under more demanding cluster-based data splitting revealed that MACE-OFF retained the strongest performance across representations, suggesting that its learned embeddings generalise more effectively than hand-crafted descriptors to molecules that are more dissimilar to the training set distribution. Predictability for impact sensitivity improved noticeably when recast as a classification task, where CheMeleon emerged with comparable performance to the hand-crafted descriptors. These results show that while foundation model embeddings can provide useful low-input screening tools for energetic materials, they are not yet a competitive replacement for the bespoke models trained on larger datasets.

Authors

Institutions

Publication Details

Journal
ChemRxiv
Published
2026-11-16
DOI
https://doi.org/10.26434/chemrxiv.15012261/v1
Primary Topic
Energetic Materials and Combustion
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Assessing the transfer-learning performance of foundation models for energetic materials property prediction under low-data conditions

Carole A. Morrison, Sohan Seth, Karthik Mohan, Andreas Backman
4 links
ChemRxiv
Energetic Materials and Combustion
preprint

Assessing the transfer-learning performance of foundation models for energetic materials property prediction under low-data conditions

Carole A. Morrison, Sohan Seth, Karthik Mohan, Andreas Backman
preprint en

Abstract

This study evaluates the performance of off-the-shelf foundation model embeddings provided by CheMeleon, MolCLR, and MACE-OFF to predict energetic material properties from sparse datasets. Models were trained to predict crystal density, heat of formation and impact sensitivity from SMILES strings, with performance benchmarked against molecular representations provided by Morgan fingerprints and hand-crafted descriptors. Overall, the foundation model embeddings were found to be competitive with the hand-crafted descriptors, with MACE-OFF showing the strongest performance in numerical regression tasks. Heat of formation was found to be the most predictable property (R2 = 0.72), followed by crystal density (R2 = 0.54) and impact sensitivity (R2 = 0.47). Testing under more demanding cluster-based data splitting revealed that MACE-OFF retained the strongest performance across representations, suggesting that its learned embeddings generalise more effectively than hand-crafted descriptors to molecules that are more dissimilar to the training set distribution. Predictability for impact sensitivity improved noticeably when recast as a classification task, where CheMeleon emerged with comparable performance to the hand-crafted descriptors. These results show that while foundation model embeddings can provide useful low-input screening tools for energetic materials, they are not yet a competitive replacement for the bespoke models trained on larger datasets.

ChemRxiv
University of Edinburgh (GB)
Energetic Materials and Combustion
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon