The criterion layer: bringing human judgment to AI agents

Quem trabalha com agentes viu o que as skills acrescentaram: o agente deixou de improvisar o procedimento e passou a carregar o jeito certo de fazer. O critério é o passo seguinte. Ele leva ao orquestrador, a cada agente e a cada skill o que a skill não carrega: o julgamento de quem responde pelo resultado. Proponho uma camada de critério: arquivos declarados, versionados e verificáveis, um por elemento da arquitetura. A camada já foi testada em uso real, e eu vi o resultado: o orquestrador, os agentes e a skill que receberam o "critério" passaram a entregar melhor. Este artigo mostra o cenário, a arquitetura, a ordem das decisões, a forma de medir e o que já foi observado. ENGLISH Anyone working with agents saw what skills added: the agent stopped improvising the procedure and started carrying the right way to do the work. The criterion is the next step. It brings to the orchestrator, to every agent and to every skill what a skill does not carry: the judgment of whoever answers for the result. I propose a criterion layer: declared, versioned and verifiable files, one per element of the architecture. The layer has already been tested in real use, and I saw the result: the orchestrator, the agents and the skill that received the "criterion" started delivering better. This article covers the landscape, the architecture, the order of decisions, how the gain is measured and what has been observed so far.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-15
DOI
https://doi.org/10.5281/zenodo.24248511
Primary Topic
Artificial Intelligence Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

The criterion layer: bringing human judgment to AI agents

Rafael Vieira Rodrigues Silva
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence Applications
article

The criterion layer: bringing human judgment to AI agents

Rafael Vieira Rodrigues Silva
article en

Abstract

Quem trabalha com agentes viu o que as skills acrescentaram: o agente deixou de improvisar o procedimento e passou a carregar o jeito certo de fazer. O critério é o passo seguinte. Ele leva ao orquestrador, a cada agente e a cada skill o que a skill não carrega: o julgamento de quem responde pelo resultado. Proponho uma camada de critério: arquivos declarados, versionados e verificáveis, um por elemento da arquitetura. A camada já foi testada em uso real, e eu vi o resultado: o orquestrador, os agentes e a skill que receberam o "critério" passaram a entregar melhor. Este artigo mostra o cenário, a arquitetura, a ordem das decisões, a forma de medir e o que já foi observado. ENGLISH Anyone working with agents saw what skills added: the agent stopped improvising the procedure and started carrying the right way to do the work. The criterion is the next step. It brings to the orchestrator, to every agent and to every skill what a skill does not carry: the judgment of whoever answers for the result. I propose a criterion layer: declared, versioned and verifiable files, one per element of the architecture. The layer has already been tested in real use, and I saw the result: the orchestrator, the agents and the skill that received the "criterion" started delivering better. This article covers the landscape, the architecture, the order of decisions, how the gain is measured and what has been observed so far.

Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon