Success Provides Direction, Failure Provides Precision: A Structured Audit of Failure Data in LLM Training(成功给方向,失败给精度:大模型训练中失败数据的结构化审计)
This repository contains the manuscripts, audit protocol, codebook, and reproducible coding data for a structured audit of failure-data practice in LLM training. We audit 33 units across two layers — public training datasets and open recipes (28 units), plus the five flagship pipelines disclosed in autumn 2026 (GPT-6 Astra, Claude Opus 5.5, GLM-5.3, MiMo-V2.6, DeepSeek-V4.1-Flash) — using a five-level ordinal lifecycle codebook: L0 discarded / L1 shadow / L2 transient / L3 component / L4 first-class citizen (error localization + attribution + reflection at scale). Key findings: the L4 tier is vacant (0/33); mainstream open recipes reach no higher than L2 (0/15 at L3, SFT layer 7/7 L0); the 2026 autumn flagships show a generational shift (4/5 at L3, ordinal median L1 to L3); and the carrier of failure signals is migrating from preference pairs (6/15 mainstream units) to RL environments and audit loops (0/14 flagship mechanisms). Includes English and Chinese manuscripts, the L0-L4 codebook, and machine-readable coding records (44 mechanism-level entries with supporting quotations, source URLs, and confidence tiers).
Authors
- Yugui Yu
Institutions
- Global Strategy Group (US)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-10-14
- DOI
- https://doi.org/10.5281/zenodo.23355929
- Citations
- 1
- Primary Topic
- Topic Modeling
- Type
- preprint