Artifact-Driven Methodology for LLM Coding Agents

LLM coding agents produce plausible work that too often misses the working bar, and the costly failures are quiet: a capable agent optimizes the legible completion signal and trades away what is not pinned. This paper describes an artifact-driven methodology for containing that, reached by running agents on real work over fourteen months. Its central cut is enforcement substrate. Instructions (text the agent reads) produce intent; programs (execution graphs an orchestrator runs with per-node verification) produce enforcement. Around that cut sit a spec-and-plan artifact stack; a tooling layer that grounds the agent's view of the code in structural analysis rather than narrative; a verification stack of orchestrator-enforced gates, where a mechanical check decides only what it can actually decide (artifact structure, an external side effect such as a process starting) and coding work is gated by pre-registered contracts interpreted by decorrelated, active reviewers (there is no mechanical check for whether code is right; that going-in bet failed and its failure is reported); and a principal-plus-three-window actor model (human, operator, worker, and a non-agent orchestrator) with a mechanically enforced submission gate between alignment and execution. The methodology is realized in an open-source, self-hosting reference implementation and demonstrated as Design Science Research in three regimes: greenfield, rewrite against a legacy oracle, and self-hosting. A multi-vendor trace-turn corpus provides preliminary empirical signals. The claim is deliberately bounded. No layer grounds the work; the methodology's job is to make the quiet sacrifices loud and hand the rest to the human. The bet is workflow-economic (practically usable code at less human attention), not a proof of grounded verification.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-02
DOI
https://doi.org/10.5281/zenodo.21139628
Primary Topic
Business Law and Ethics
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Artifact-Driven Methodology for LLM Coding Agents

Herman Phil Marneweck
Zenodo (CERN European Organization for Nuclear Research)
Business Law and Ethics
preprint

Artifact-Driven Methodology for LLM Coding Agents

Herman Phil Marneweck
preprint en

Abstract

LLM coding agents produce plausible work that too often misses the working bar, and the costly failures are quiet: a capable agent optimizes the legible completion signal and trades away what is not pinned. This paper describes an artifact-driven methodology for containing that, reached by running agents on real work over fourteen months. Its central cut is enforcement substrate. Instructions (text the agent reads) produce intent; programs (execution graphs an orchestrator runs with per-node verification) produce enforcement. Around that cut sit a spec-and-plan artifact stack; a tooling layer that grounds the agent's view of the code in structural analysis rather than narrative; a verification stack of orchestrator-enforced gates, where a mechanical check decides only what it can actually decide (artifact structure, an external side effect such as a process starting) and coding work is gated by pre-registered contracts interpreted by decorrelated, active reviewers (there is no mechanical check for whether code is right; that going-in bet failed and its failure is reported); and a principal-plus-three-window actor model (human, operator, worker, and a non-agent orchestrator) with a mechanically enforced submission gate between alignment and execution. The methodology is realized in an open-source, self-hosting reference implementation and demonstrated as Design Science Research in three regimes: greenfield, rewrite against a legacy oracle, and self-hosting. A multi-vendor trace-turn corpus provides preliminary empirical signals. The claim is deliberately bounded. No layer grounds the work; the methodology's job is to make the quiet sacrifices loud and hand the rest to the human. The bet is workflow-economic (practically usable code at less human attention), not a proof of grounded verification.

Zenodo (CERN European Organization for Nuclear Research)
Business Law and Ethics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Artifact-Driven Methodology for LLM Coding Agents — Herman Phil Marneweck · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS