AI Limits for the CCS Parsing Model

Could an AI have invented the CCS parsing model from the requirements it satisfies? Five fresh Claude Code sessions, each with no access to the project, were given one 350-word brief stating seven requirements (five-language consumption of one parse output, byte-for-byte regeneration, a consumer that works from the output alone, diff-based cross-language agreement, self-hosting, no semantic actions, LL(1) with reading as the hot path) and asked for an architecture-level design. A sixth fresh session scored the five blind. All five converged on the same structure: a flat, lossless concrete syntax tree laid over the verbatim input, in the tree-sitter and Roslyn lineage. None produced the four-entity (Context, Name, Symbol, Rule) model that replaces the tree in CCS, and none produced its two-phase architecture of a mutable runtime followed by a bidirectional binary. Of the six published departures from the YACC lineage, three were forced by the requirements, one only weakly, and two not at all. The paper records the protocol, the five designs, the blind scores, the informed comparison, an argument for why behavioral requirements cannot carry an ontological choice, the experiment's known weaknesses, and two follow-up rounds. > If you can program a little, you can follow this. The question is > simple: give an AI a list of requirements, and does it come back > with the invention those requirements were written from? We > measured it. The answer is no, and the interesting part is why.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-06
DOI
https://doi.org/10.5281/zenodo.22548361
Primary Topic
Natural Language Processing Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

AI Limits for the CCS Parsing Model

Aleksandr F. Urakhchin
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
preprint

AI Limits for the CCS Parsing Model

Aleksandr F. Urakhchin
preprint en

Abstract

Could an AI have invented the CCS parsing model from the requirements it satisfies? Five fresh Claude Code sessions, each with no access to the project, were given one 350-word brief stating seven requirements (five-language consumption of one parse output, byte-for-byte regeneration, a consumer that works from the output alone, diff-based cross-language agreement, self-hosting, no semantic actions, LL(1) with reading as the hot path) and asked for an architecture-level design. A sixth fresh session scored the five blind. All five converged on the same structure: a flat, lossless concrete syntax tree laid over the verbatim input, in the tree-sitter and Roslyn lineage. None produced the four-entity (Context, Name, Symbol, Rule) model that replaces the tree in CCS, and none produced its two-phase architecture of a mutable runtime followed by a bidirectional binary. Of the six published departures from the YACC lineage, three were forced by the requirements, one only weakly, and two not at all. The paper records the protocol, the five designs, the blind scores, the informed comparison, an argument for why behavioral requirements cannot carry an ontological choice, the experiment's known weaknesses, and two follow-up rounds. > If you can program a little, you can follow this. The question is > simple: give an AI a list of requirements, and does it come back > with the invention those requirements were written from? We > measured it. The answer is no, and the interesting part is why.

Zenodo (CERN European Organization for Nuclear Research)
China Three Gorges Corporation (China) (CN)
Quality Education
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.