FidelityEight: Frozen-Protocol Fidelity Measurements of the Distributed Jacobian-Lens Checkpoints

The Jacobian lens ("jlens"), released 2026-07-02 as companion code to the *Verbalizable Workspace* paper, ships with pre-fitted checkpoints for ~36–38 model families. To our knowledge — a bounded-absence claim; see §6 for the search scope — no direct lens-versus-model fidelity measurement of these distributed checkpoints (rank agreement, KL divergence, top-1 agreement, or calibration) has been published by any party, including the upstream authors. This note contributes six fidelity readings of three distributed checkpoints under two position-domain bindings, plus two measured floors (chance and vanilla logit-lens), all under a frozen protocol: a rank-based fidelity statistic (wgrd) preregistered before each run, evaluated on a fixed 266-item prose set, with a positive/negative-control calibration battery passed in the same invocation as every measurement, and md5-pinned instruments, inputs, and outputs throughout. The distributed OLMo-3-7B lens reads 1.39 dex (median word-group rank deviation from the model it explains), the OLMo-3-32B lens 1.57 dex, and the Qwen3-8B lens 2.44 dex on its own tokenizer scale; the chance floor sits at 4.47 dex and the vanilla logit-lens baseline at 1.84 dex on the 7B ground. All values are robust to a position-domain correction aligned with the lens's own fit domain (largest shift: 0.10 dex). We report these as instrument characterization only: they license no claim about the models, about the upstream fitting objective, or about any downstream hypothesis. Instrument ineligibility is not refutation.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-18
DOI
https://doi.org/10.5281/zenodo.21990389
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

FidelityEight: Frozen-Protocol Fidelity Measurements of the Distributed Jacobian-Lens Checkpoints

Manabu Higashida
Zenodo (CERN European Organization for Nuclear Research)
Explainable Artificial Intelligence (XAI)
preprint

FidelityEight: Frozen-Protocol Fidelity Measurements of the Distributed Jacobian-Lens Checkpoints

Manabu Higashida
preprint en

Abstract

The Jacobian lens ("jlens"), released 2026-07-02 as companion code to the *Verbalizable Workspace* paper, ships with pre-fitted checkpoints for ~36–38 model families. To our knowledge — a bounded-absence claim; see §6 for the search scope — no direct lens-versus-model fidelity measurement of these distributed checkpoints (rank agreement, KL divergence, top-1 agreement, or calibration) has been published by any party, including the upstream authors. This note contributes six fidelity readings of three distributed checkpoints under two position-domain bindings, plus two measured floors (chance and vanilla logit-lens), all under a frozen protocol: a rank-based fidelity statistic (wgrd) preregistered before each run, evaluated on a fixed 266-item prose set, with a positive/negative-control calibration battery passed in the same invocation as every measurement, and md5-pinned instruments, inputs, and outputs throughout. The distributed OLMo-3-7B lens reads 1.39 dex (median word-group rank deviation from the model it explains), the OLMo-3-32B lens 1.57 dex, and the Qwen3-8B lens 2.44 dex on its own tokenizer scale; the chance floor sits at 4.47 dex and the vanilla logit-lens baseline at 1.84 dex on the 7B ground. All values are robust to a position-domain correction aligned with the lens's own fit domain (largest shift: 0.10 dex). We report these as instrument characterization only: they license no claim about the models, about the upstream fitting objective, or about any downstream hypothesis. Instrument ineligibility is not refutation.

Zenodo (CERN European Organization for Nuclear Research)
Osaka University of Economics (JP), Osaka Health Science University (JP)
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

FidelityEight: Frozen-Protocol Fidelity Measurements of the Distributed Jacobian-Lens Checkpoints — Manabu Higashida · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS