Metamorphic Coverage and Reward Sensitivity in Agent Programs

We test whether a repaired verifier accepts archived agent programs that fail fresh, reference-qualified input probes. The study covers 100 programs for one session-window component. Before execution, we freeze 120 traces combining six source-name bijections, five positive event-time scales and four offsets. A shipped reference and two planted controls qualify the harness. Each case runs in a fresh isolated process. All 12,000 program–case executions complete. Ninety-eight programs match every declared contract vector; two differ at identity and every transformed case. All 100 satisfy own-anchor equivariance. Source inspection explains the two differing vectors through alternative event-count idleness policies, which the short task design does not fully resolve. The 119 nonidentity cases add no departures among identity-conforming programs. Replication of baseline-to-repaired scoring changes two labels and ten standardized reward coefficients on fixed evaluation cohorts; probe augmentation changes none. A census of 794 public records supplies archival context. The measurements concern saved programs and include no policy update. We propose an unrun matched private-task experiment to test whether verifier repair improves training outcomes at a defensible cost. Materials. The PDF, editable source, vector figures and sanitized observations accompany the reproduction code. Public benchmark material remains evaluation-only. This is a preprint and has not been peer reviewed. Computational assistance. OpenAI Codex, including GPT-6.1-Sol, assisted study design, literature review, implementation, analysis, figure generation and manuscript preparation. Reported measurements come from logged code executions; the record includes the code and observations needed to reproduce the analysis.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-08
DOI
https://doi.org/10.5281/zenodo.24062638
Primary Topic
Software Testing and Debugging Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Metamorphic Coverage and Reward Sensitivity in Agent Programs

Musa Emin Ozdem, Faruk Ozdem, Rumeysa Egri, Akil Ahlat
3 links
Zenodo (CERN European Organization for Nuclear Research)
Software Testing and Debugging Techniques
preprint

Metamorphic Coverage and Reward Sensitivity in Agent Programs

Musa Emin Ozdem, Faruk Ozdem, Rumeysa Egri, Akil Ahlat
preprint en

Abstract

We test whether a repaired verifier accepts archived agent programs that fail fresh, reference-qualified input probes. The study covers 100 programs for one session-window component. Before execution, we freeze 120 traces combining six source-name bijections, five positive event-time scales and four offsets. A shipped reference and two planted controls qualify the harness. Each case runs in a fresh isolated process. All 12,000 program–case executions complete. Ninety-eight programs match every declared contract vector; two differ at identity and every transformed case. All 100 satisfy own-anchor equivariance. Source inspection explains the two differing vectors through alternative event-count idleness policies, which the short task design does not fully resolve. The 119 nonidentity cases add no departures among identity-conforming programs. Replication of baseline-to-repaired scoring changes two labels and ten standardized reward coefficients on fixed evaluation cohorts; probe augmentation changes none. A census of 794 public records supplies archival context. The measurements concern saved programs and include no policy update. We propose an unrun matched private-task experiment to test whether verifier repair improves training outcomes at a defensible cost. Materials. The PDF, editable source, vector figures and sanitized observations accompany the reproduction code. Public benchmark material remains evaluation-only. This is a preprint and has not been peer reviewed. Computational assistance. OpenAI Codex, including GPT-6.1-Sol, assisted study design, literature review, implementation, analysis, figure generation and manuscript preparation. Reported measurements come from logged code executions; the record includes the code and observations needed to reproduce the analysis.

Zenodo (CERN European Organization for Nuclear Research)
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon