Constructing Language Judgments: Rubric Distillation and Evidence-Grounded Reasoning

Gnomon investigates the construction of language judgments through rubric-grounded reasoning, structured supervision and an evidence-verifying execution harness. Rather than asking a model to predict a score and justify it afterward, the architecture compiles declarative rubric specifications into a versioned item bank shared by evidence elicitation and scoring. Model-derived observations pass through exact-span verification, relation-level credit accounting and constrained criterion aggregation, making the transformations from source text to judgment inspectable. The learning infrastructure operationalizes rubric distillation through structured extraction targets, verifier-filtered attempt selection and candidate-bound critique-and-repair examples. Completion-focused parameter-efficient training preserves example weighting across microbatches; chunked vocabulary projection and supervised-token accounting support resource-aware execution. Together, these components connect the inference harness, judgment construction and training-data feedback loop. IELTS writing assessment is the implemented application, not a claim that the architecture has been validated across all language-judgment domains. The report documents system interfaces, five explanatory figures and an executed archived-input replay. Historical Task-2 records report criterion MAEs of 0.226–0.319 on 157 essays with source-specific calibration; these are contextual results, not a current-engine comparative benchmark. Reasoning refers to explicit evidence transformations, not access to hidden model cognition. Independent technical report, revision 14; not peer reviewed.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-09
DOI
https://doi.org/10.5281/zenodo.22675790
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Constructing Language Judgments: Rubric Distillation and Evidence-Grounded Reasoning

Ba Hoang Minh Vo
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
article

Constructing Language Judgments: Rubric Distillation and Evidence-Grounded Reasoning

Ba Hoang Minh Vo
article en

Abstract

Gnomon investigates the construction of language judgments through rubric-grounded reasoning, structured supervision and an evidence-verifying execution harness. Rather than asking a model to predict a score and justify it afterward, the architecture compiles declarative rubric specifications into a versioned item bank shared by evidence elicitation and scoring. Model-derived observations pass through exact-span verification, relation-level credit accounting and constrained criterion aggregation, making the transformations from source text to judgment inspectable. The learning infrastructure operationalizes rubric distillation through structured extraction targets, verifier-filtered attempt selection and candidate-bound critique-and-repair examples. Completion-focused parameter-efficient training preserves example weighting across microbatches; chunked vocabulary projection and supervised-token accounting support resource-aware execution. Together, these components connect the inference harness, judgment construction and training-data feedback loop. IELTS writing assessment is the implemented application, not a claim that the architecture has been validated across all language-judgment domains. The report documents system interfaces, five explanatory figures and an executed archived-input replay. Historical Task-2 records report criterion MAEs of 0.226–0.319 on 157 essays with source-specific calibration; these are contextual results, not a current-engine comparative benchmark. Reasoning refers to explicit evidence transformations, not access to hidden model cognition. Independent technical report, revision 14; not peer reviewed.

Zenodo (CERN European Organization for Nuclear Research)
Industry, innovation and infrastructure
Openalex Percentile: Top 8%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.