Constructing Language Judgments: Rubric Distillation and Evidence-Grounded Reasoning

Gnomon investigates the construction of language judgments through rubric-grounded reasoning, structured supervision and an evidence-verifying execution harness. Rather than asking a model to predict a score and justify it afterward, the architecture compiles declarative rubric specifications into a versioned item bank shared by evidence elicitation and scoring. Model-derived observations pass through exact-span verification, relation-level credit accounting and constrained criterion aggregation, making the transformations from source text to judgment inspectable. The learning infrastructure operationalizes rubric distillation through structured extraction targets, verifier-filtered attempt selection and candidate-bound critique-and-repair examples. Completion-focused parameter-efficient training preserves example weighting across microbatches; chunked vocabulary projection and supervised-token accounting support resource-aware execution. Together, these components connect the inference harness, judgment construction and training-data feedback loop. IELTS writing assessment is the implemented application, not a claim that the architecture has been validated across all language-judgment domains. The report documents system interfaces, five explanatory figures and an executed archived-input replay. Historical Task-2 records report criterion MAEs of 0.226–0.319 on 157 essays with source-specific calibration; these are contextual results, not a current-engine comparative benchmark. Reasoning refers to explicit evidence transformations, not access to hidden model cognition. Independent technical report, revision 14.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-11
DOI
https://doi.org/10.5281/zenodo.22708358
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Constructing Language Judgments: Rubric Distillation and Evidence-Grounded Reasoning

Ba Hoang Minh Vo
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
article

Constructing Language Judgments: Rubric Distillation and Evidence-Grounded Reasoning

Ba Hoang Minh Vo
article en

Abstract

Gnomon investigates the construction of language judgments through rubric-grounded reasoning, structured supervision and an evidence-verifying execution harness. Rather than asking a model to predict a score and justify it afterward, the architecture compiles declarative rubric specifications into a versioned item bank shared by evidence elicitation and scoring. Model-derived observations pass through exact-span verification, relation-level credit accounting and constrained criterion aggregation, making the transformations from source text to judgment inspectable. The learning infrastructure operationalizes rubric distillation through structured extraction targets, verifier-filtered attempt selection and candidate-bound critique-and-repair examples. Completion-focused parameter-efficient training preserves example weighting across microbatches; chunked vocabulary projection and supervised-token accounting support resource-aware execution. Together, these components connect the inference harness, judgment construction and training-data feedback loop. IELTS writing assessment is the implemented application, not a claim that the architecture has been validated across all language-judgment domains. The report documents system interfaces, five explanatory figures and an executed archived-input replay. Historical Task-2 records report criterion MAEs of 0.226–0.319 on 157 essays with source-specific calibration; these are contextual results, not a current-engine comparative benchmark. Reasoning refers to explicit evidence transformations, not access to hidden model cognition. Independent technical report, revision 14.

Zenodo (CERN European Organization for Nuclear Research)
Industry, innovation and infrastructure
Openalex Percentile: Top 8%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.