Success Provides Direction, Failure Provides Precision: A Structured Audit of Failure Data in LLM Training(成功给方向,失败给精度:大模型训练中失败数据的结构化审计)

This repository contains the manuscripts, audit protocol, codebook, and reproducible coding data for a structured audit of failure-data practice in LLM training. We audit 33 units across two layers — public training datasets and open recipes (28 units), plus the five flagship pipelines disclosed in autumn 2026 (GPT-6 Astra, Claude Opus 5.5, GLM-5.3, MiMo-V2.6, DeepSeek-V4.1-Flash) — using a five-level ordinal lifecycle codebook: L0 discarded / L1 shadow / L2 transient / L3 component / L4 first-class citizen (error localization + attribution + reflection at scale). Key findings: the L4 tier is vacant (0/33); mainstream open recipes reach no higher than L2 (0/15 at L3, SFT layer 7/7 L0); the 2026 autumn flagships show a generational shift (4/5 at L3, ordinal median L1 to L3); and the carrier of failure signals is migrating from preference pairs (6/15 mainstream units) to RL environments and audit loops (0/14 flagship mechanisms). Includes English and Chinese manuscripts, the L0-L4 codebook, and machine-readable coding records (44 mechanism-level entries with supporting quotations, source URLs, and confidence tiers).

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-14
DOI
https://doi.org/10.5281/zenodo.23355929
Citations
1
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Success Provides Direction, Failure Provides Precision: A Structured Audit of Failure Data in LLM Training(成功给方向,失败给精度:大模型训练中失败数据的结构化审计)

Yugui Yu
1 citations
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

Success Provides Direction, Failure Provides Precision: A Structured Audit of Failure Data in LLM Training(成功给方向,失败给精度:大模型训练中失败数据的结构化审计)

Yugui Yu
preprint en
1 citations

Abstract

This repository contains the manuscripts, audit protocol, codebook, and reproducible coding data for a structured audit of failure-data practice in LLM training. We audit 33 units across two layers — public training datasets and open recipes (28 units), plus the five flagship pipelines disclosed in autumn 2026 (GPT-6 Astra, Claude Opus 5.5, GLM-5.3, MiMo-V2.6, DeepSeek-V4.1-Flash) — using a five-level ordinal lifecycle codebook: L0 discarded / L1 shadow / L2 transient / L3 component / L4 first-class citizen (error localization + attribution + reflection at scale). Key findings: the L4 tier is vacant (0/33); mainstream open recipes reach no higher than L2 (0/15 at L3, SFT layer 7/7 L0); the 2026 autumn flagships show a generational shift (4/5 at L3, ordinal median L1 to L3); and the carrier of failure signals is migrating from preference pairs (6/15 mainstream units) to RL environments and audit loops (0/14 flagship mechanisms). Includes English and Chinese manuscripts, the L0-L4 codebook, and machine-readable coding records (44 mechanism-level entries with supporting quotations, source URLs, and confidence tiers).

Zenodo (CERN European Organization for Nuclear Research)
Global Strategy Group (US)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.