E1 Audit-Capability Matrix v1.2: Confirmatory Protocol and 96-Cell Evidence Snapshot

Confirmatory E1 study protocol v1.2: 6 new agent-memory systems × 16 cells = 96 cells, with a revised four-value codebook (full/partial/none/unverifiable; partial must name the missing element). Primary outcome: four-class Cohen's κ ≥ 0.61. Annotators: GLM-5.3 and DeepSeek V4 Flash 0731 (raw); disputes adjudicated by Qwen3.5-122B-A10B and Hunyuan-A13B-Instruct (SiliconFlow raw). The evidence snapshot covers 96 cells (12 code-level, 84 documentation-level) with ratings intentionally blank. A prior 96-cell study (κ = 0.578 overall; 0.626 judgeable) is exploratory and is not the confirmatory result. Published before scoring; frozen after publication.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-19
DOI
https://doi.org/10.5281/zenodo.23469740
Primary Topic
Reliability and Agreement in Measurement
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

E1 Audit-Capability Matrix v1.2: Confirmatory Protocol and 96-Cell Evidence Snapshot

Qian Zhang
Zenodo (CERN European Organization for Nuclear Research)
Reliability and Agreement in Measurement
article

E1 Audit-Capability Matrix v1.2: Confirmatory Protocol and 96-Cell Evidence Snapshot

Qian Zhang
article en

Abstract

Confirmatory E1 study protocol v1.2: 6 new agent-memory systems × 16 cells = 96 cells, with a revised four-value codebook (full/partial/none/unverifiable; partial must name the missing element). Primary outcome: four-class Cohen's κ ≥ 0.61. Annotators: GLM-5.3 and DeepSeek V4 Flash 0731 (raw); disputes adjudicated by Qwen3.5-122B-A10B and Hunyuan-A13B-Instruct (SiliconFlow raw). The evidence snapshot covers 96 cells (12 code-level, 84 documentation-level) with ratings intentionally blank. A prior 96-cell study (κ = 0.578 overall; 0.626 judgeable) is exploratory and is not the confirmatory result. Published before scoring; frozen after publication.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 10%
Reliability and Agreement in Measurement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

E1 Audit-Capability Matrix v1.2: Confirmatory Protocol and 96-Cell Evidence Snapshot — Qian Zhang · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS