Noma: An Open System One Decision Model from a Sliced Decoder and Trained Heads

System One decision models answer typed questions about a state in a single forward pass, returning a probability for every option and no generated text. The class was introduced with Jev, a hosted model. We present Noma, an open-weight model in this class, and a measured account of its design: a pretrained 4B decoder sliced to its first 18 of 32 layers, trained decision heads that read one hidden state per option, a separately supervised abstain head, and a fast serving path. On single-pass decisions Noma scores 82.6% on a sealed, human-reviewed set that we also used to compare development runs (81.3% for a fresh re-training of the same design), with mean confidence about two points above accuracy. On two intent tasks absent from its training data it reaches 83.6% (150 options) and 70.1% (77 options) with no adaptation, and it answers in 15 ms at the median on one H100 with zero output tokens. Controlled ablations (20 runs at a 6,000-item recipe, paired per item) show which parts carry this. Slicing loses no measured accuracy (79.4% against 79.4% over three seeds each; 95% interval on the difference [-2.6, +2.7]). The abstain output is informative only when it is supervised (area under the ROC curve 0.82 against 0.46, one seed, 15 items). The option head can be small: one pointwise head about an eighth the size of the four-head listwise reference scores 80.2% against 79.4% (difference +0.8 [-1.3, +2.8]), and with all the training data the two designs remain within noise of each other. A single pass has limits: on 56 held-out items that need chained computation, every configuration with at least 18 layers scores between 44.6% and 62.5% (chance is 33.5%), the released model's confidence is 23 points above its accuracy, and 9.7% of multiple-choice answers change when the options are reversed. Code and weights are open.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-06
DOI
https://doi.org/10.5281/zenodo.23186352
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Noma: An Open System One Decision Model from a Sliced Decoder and Trained Heads

Atul Saxena, DIVYANSHI SHARMA
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
article

Noma: An Open System One Decision Model from a Sliced Decoder and Trained Heads

Atul Saxena, DIVYANSHI SHARMA
article en

Abstract

System One decision models answer typed questions about a state in a single forward pass, returning a probability for every option and no generated text. The class was introduced with Jev, a hosted model. We present Noma, an open-weight model in this class, and a measured account of its design: a pretrained 4B decoder sliced to its first 18 of 32 layers, trained decision heads that read one hidden state per option, a separately supervised abstain head, and a fast serving path. On single-pass decisions Noma scores 82.6% on a sealed, human-reviewed set that we also used to compare development runs (81.3% for a fresh re-training of the same design), with mean confidence about two points above accuracy. On two intent tasks absent from its training data it reaches 83.6% (150 options) and 70.1% (77 options) with no adaptation, and it answers in 15 ms at the median on one H100 with zero output tokens. Controlled ablations (20 runs at a 6,000-item recipe, paired per item) show which parts carry this. Slicing loses no measured accuracy (79.4% against 79.4% over three seeds each; 95% interval on the difference [-2.6, +2.7]). The abstain output is informative only when it is supervised (area under the ROC curve 0.82 against 0.46, one seed, 15 items). The option head can be small: one pointwise head about an eighth the size of the four-head listwise reference scores 80.2% against 79.4% (difference +0.8 [-1.3, +2.8]), and with all the training data the two designs remain within noise of each other. A single pass has limits: on 56 held-out items that need chained computation, every configuration with at least 18 layers scores between 44.6% and 62.5% (chance is 33.5%), the released model's confidence is 23 points above its accuracy, and 9.7% of multiple-choice answers change when the options are reversed. Code and weights are open.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 11%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.