Configuration selection and matrix-aware optimization for data-efficient atomistic foundation models

Atomistic foundation models achieve high accuracy by training on very large labeled datasets. However, it remains unclear how much of this data is actually needed. Data-efficient training requires a better understanding of the roles of both data selection and model optimization. Here, we study these two factors separately using MACE-OFF24 as a baseline. We build smaller training sets by selecting configurations to cover diverse local atomic environments and include cases with large teacher-model errors. We then compare AdamW with the matrix-aware Muon optimizer using the same training data. We selected approximately 21% of the available configurations (190,000 for training and 10,000 for validation). Training from scratch produced energy and force root-mean-square errors within 8.1% and 6% of those obtained with the published checkpoint. On the fixed 200k subset, Muon reduced mean energy and force errors by 29% and 6% relative to AdamW. In a single-run comparison of selection rules within a fixed candidate pool at 49k, the 80:20 representative/residual allocation gave the lowest observed energy and force errors. On a separate small test set of approximately 7,000 3BPA conformers, AdamW instead gave the lowest mean relative-energy and energy-span errors. Our results show that data-efficient training of atomistic foundation models is jointly controlled by configuration coverage, optimizer geometry, chemical regime, and target observable. Especially, for training on big datasets, matrix-aware updates can improve broad from-scratch energy-force training.

Authors

Institutions

Publication Details

Journal
Journal of Materials Informatics
Published
2026-11-18
DOI
https://doi.org/10.20517/jmi.2026.62
Primary Topic
Machine Learning in Materials Science
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Configuration selection and matrix-aware optimization for data-efficient atomistic foundation models

Lei Shen, Yangshuai Wang, Xiaoqing Liu
3 links
Journal of Materials Informatics
Machine Learning in Materials Science
article

Configuration selection and matrix-aware optimization for data-efficient atomistic foundation models

Lei Shen, Yangshuai Wang, Xiaoqing Liu
article en

Abstract

Atomistic foundation models achieve high accuracy by training on very large labeled datasets. However, it remains unclear how much of this data is actually needed. Data-efficient training requires a better understanding of the roles of both data selection and model optimization. Here, we study these two factors separately using MACE-OFF24 as a baseline. We build smaller training sets by selecting configurations to cover diverse local atomic environments and include cases with large teacher-model errors. We then compare AdamW with the matrix-aware Muon optimizer using the same training data. We selected approximately 21% of the available configurations (190,000 for training and 10,000 for validation). Training from scratch produced energy and force root-mean-square errors within 8.1% and 6% of those obtained with the published checkpoint. On the fixed 200k subset, Muon reduced mean energy and force errors by 29% and 6% relative to AdamW. In a single-run comparison of selection rules within a fixed candidate pool at 49k, the 80:20 representative/residual allocation gave the lowest observed energy and force errors. On a separate small test set of approximately 7,000 3BPA conformers, AdamW instead gave the lowest mean relative-energy and energy-span errors. Our results show that data-efficient training of atomistic foundation models is jointly controlled by configuration coverage, optimizer geometry, chemical regime, and target observable. Especially, for training on big datasets, matrix-aware updates can improve broad from-scratch energy-force training.

Journal of Materials InformaticsVol. 6(4)
National University of Singapore (SG)
Machine Learning in Materials Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon