Model cards are not primary artifacts: stereochemistry in the MoLFormer and SMI-TED chemical foundation models

Pretrained chemical language models are selected, embedded with, and fine tuned on the basis of what their documentation says they are. We report that the released model card for MoLFormer, one of the most widely used chemical foundation models, states that isomeric information was removed from its training data, and that this statement is contradicted by artifacts distributed in the model's own repository. The shipped token frequency table records the tetrahedral stereocentre token [C@H] occurring 669,642,207 times, making it the twelfth most frequent token in a corpus of 47.2 billion tokens, ahead of fluorine, and stereochemical tokens account for 3.17% of all token occurrences. The described stripping is real but occurs at a different pipeline stage: isomeric = False is hardcoded into the fine tuning scripts and applied to downstream benchmark data, not to pretraining. We find a related divergence in SMI-TED, whose released vocabulary contains 2,393 tokens rather than the 2,988 reported, and whose shipped frequency table is identical to MoLFormer's, byte for byte, across all 2,357 shared tokens, despite the paper describing a different corpus. We release the extracted frequency table and an audit tool, and recommend that chemical model cards state stereochemistry handling separately for pretraining, fine tuning, and inference.

Authors

Institutions

Publication Details

Journal
Journal of Cheminformatics
Published
2026-11-11
DOI
https://doi.org/10.1186/s13321-026-01318-y
Primary Topic
Computational Drug Discovery Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Model cards are not primary artifacts: stereochemistry in the MoLFormer and SMI-TED chemical foundation models

Nathan Kaplan
Journal of Cheminformatics
Computational Drug Discovery Methods
article

Model cards are not primary artifacts: stereochemistry in the MoLFormer and SMI-TED chemical foundation models

Nathan Kaplan
article en

Abstract

Pretrained chemical language models are selected, embedded with, and fine tuned on the basis of what their documentation says they are. We report that the released model card for MoLFormer, one of the most widely used chemical foundation models, states that isomeric information was removed from its training data, and that this statement is contradicted by artifacts distributed in the model's own repository. The shipped token frequency table records the tetrahedral stereocentre token [C@H] occurring 669,642,207 times, making it the twelfth most frequent token in a corpus of 47.2 billion tokens, ahead of fluorine, and stereochemical tokens account for 3.17% of all token occurrences. The described stripping is real but occurs at a different pipeline stage: isomeric = False is hardcoded into the fine tuning scripts and applied to downstream benchmark data, not to pretraining. We find a related divergence in SMI-TED, whose released vocabulary contains 2,393 tokens rather than the 2,988 reported, and whose shipped frequency table is identical to MoLFormer's, byte for byte, across all 2,357 shared tokens, despite the paper describing a different corpus. We release the extracted frequency table and an audit tool, and recommend that chemical model cards state stereochemistry handling separately for pretraining, fine tuning, and inference.

Journal of CheminformaticsVol. 18(1)
The University of Texas at Austin (US)
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon