Proof-Carrying Operation: Device Agents Whose Completion Is Checked, Not Declared

Agents that operate phones decide for themselves when a task is done, and most of their failures happen at that decision: they stop before every part of a multi-step goal is finished, give up when evidence is hard to find, or report facts they never checked. We move the decision from the model to a checker. In proof-carrying operation (PCO) the agent compiles the goal into typed obligations and closes each with the value it claims and the recorded screen that shows it; a deterministic checker accepts a claim only if that screen's UI tree contains it, challenges claims of absence, and completes the final answer only from proven facts. On iOSWorld, PCO raises the share of fully passed tasks from 77/133 to 90/133 and the mean rubric score from 0.857 to 0.885 (exact McNemar p = 0.007), an independent repeat reproduces it (91/133), and an ablation attributes the gain to the complete, evidence-bound obligation ledger. On AndroidWorld the same operator averages 95.1% pass@1 over three seeds with no app knowledge. Code: https://github.com/verdikt-ai/verdikt. Every run, frame and statistic: https://verdikt-ai.github.io/verdikt/

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-13
DOI
https://doi.org/10.5281/zenodo.23345802
Primary Topic
Software Testing and Debugging Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Proof-Carrying Operation: Device Agents Whose Completion Is Checked, Not Declared

Kedar Haldankar, Hussein Abdinoor Mohamed
Zenodo (CERN European Organization for Nuclear Research)
Software Testing and Debugging Techniques
preprint

Proof-Carrying Operation: Device Agents Whose Completion Is Checked, Not Declared

Kedar Haldankar, Hussein Abdinoor Mohamed
preprint en

Abstract

Agents that operate phones decide for themselves when a task is done, and most of their failures happen at that decision: they stop before every part of a multi-step goal is finished, give up when evidence is hard to find, or report facts they never checked. We move the decision from the model to a checker. In proof-carrying operation (PCO) the agent compiles the goal into typed obligations and closes each with the value it claims and the recorded screen that shows it; a deterministic checker accepts a claim only if that screen's UI tree contains it, challenges claims of absence, and completes the final answer only from proven facts. On iOSWorld, PCO raises the share of fully passed tasks from 77/133 to 90/133 and the mean rubric score from 0.857 to 0.885 (exact McNemar p = 0.007), an independent repeat reproduces it (91/133), and an ablation attributes the gain to the complete, evidence-bound obligation ledger. On AndroidWorld the same operator averages 95.1% pass@1 over three seeds with no app knowledge. Code: https://github.com/verdikt-ai/verdikt. Every run, frame and statistic: https://verdikt-ai.github.io/verdikt/

Zenodo (CERN European Organization for Nuclear Research)
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.