CurateTrust-ZT: Difficulty-calibrated curation evidence for continuous zero-trust authorization of AI agents

Background Continuous authorization in zero-trust systems relies almost entirely on behavioural and network telemetry. Corrections made by human curators during routine data standardization are a largely unused trust signal, and naive correction-counting conflates task difficulty with unreliability, penalizing careful contributors assigned hard or unfamiliar data. Methods We built a difficulty- and consequence-aware Bayesian reliability model from curation-event evidence, fused with a behavioural signal inside a live Keycloak/OPA/Postgres/FastAPI authorization stack. We compared five naive baselines, a curation-only ablation, and the full fused model on two ontology-matching datasets (OAEI Conference and Anatomy), across nine simulated contributor profiles including collusion, with independent seed replicates for each experiment, one-at-a-time and factorial hyperparameter sweeps, and a dedicated cross-contributor collusion detector. Results Naive correction-counting was systematically backwards: over 30 seed replicates it rewarded contributors who accepted incorrect mappings (detection AUC 0.129, 95% CI [0.124, 0.135]). Our proposed model reduced the fairness gap between equally reliable contributors on easy versus difficult tasks to near zero (0.007, versus 0.018–0.025 for naive baselines) while detecting overt and compromised attackers well (AUC 0.721, 95% CI [0.711, 0.732]); the curation-only component alone achieved an even smaller gap (0.003). A dedicated pairwise-overlap detector ranked the true colluding pair among the five most suspicious of 1,225 candidate pairs in every tested seed. Slow, low-frequency manipulation remained difficult to detect, and this weakness replicated on the independent Anatomy dataset. Replaying 240 contributors and 96,000 curation events through the live stack produced a 0.0 false-denial rate for honest profiles, a 0.0% unauthorized-action rate for malicious and colluding contributors but 97.1% for slow attackers, and 57.9 ms mean decision latency. Conclusions Difficulty-calibrated curation evidence is a technically feasible and fair zero-trust signal, substantially more reliable than naive correction-counting under the simulated-contributor conditions evaluated here; detecting deliberately stealthy manipulation remains an open problem.

Authors

Institutions

Publication Details

Journal
Open Research Europe
Published
2026-08-27
DOI
https://doi.org/10.12688/openreseurope.24781.1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CurateTrust-ZT: Difficulty-calibrated curation evidence for continuous zero-trust authorization of AI agents

Fouad Ailabouni, Jesús-Ángel Román-Gallego
Open Research Europe
Artificial Intelligence in Healthcare and Education
article

CurateTrust-ZT: Difficulty-calibrated curation evidence for continuous zero-trust authorization of AI agents

Fouad Ailabouni, Jesús-Ángel Román-Gallego
article en

Abstract

Background Continuous authorization in zero-trust systems relies almost entirely on behavioural and network telemetry. Corrections made by human curators during routine data standardization are a largely unused trust signal, and naive correction-counting conflates task difficulty with unreliability, penalizing careful contributors assigned hard or unfamiliar data. Methods We built a difficulty- and consequence-aware Bayesian reliability model from curation-event evidence, fused with a behavioural signal inside a live Keycloak/OPA/Postgres/FastAPI authorization stack. We compared five naive baselines, a curation-only ablation, and the full fused model on two ontology-matching datasets (OAEI Conference and Anatomy), across nine simulated contributor profiles including collusion, with independent seed replicates for each experiment, one-at-a-time and factorial hyperparameter sweeps, and a dedicated cross-contributor collusion detector. Results Naive correction-counting was systematically backwards: over 30 seed replicates it rewarded contributors who accepted incorrect mappings (detection AUC 0.129, 95% CI [0.124, 0.135]). Our proposed model reduced the fairness gap between equally reliable contributors on easy versus difficult tasks to near zero (0.007, versus 0.018–0.025 for naive baselines) while detecting overt and compromised attackers well (AUC 0.721, 95% CI [0.711, 0.732]); the curation-only component alone achieved an even smaller gap (0.003). A dedicated pairwise-overlap detector ranked the true colluding pair among the five most suspicious of 1,225 candidate pairs in every tested seed. Slow, low-frequency manipulation remained difficult to detect, and this weakness replicated on the independent Anatomy dataset. Replaying 240 contributors and 96,000 curation events through the live stack produced a 0.0 false-denial rate for honest profiles, a 0.0% unauthorized-action rate for malicious and colluding contributors but 97.1% for slow attackers, and 57.9 ms mean decision latency. Conclusions Difficulty-calibrated curation evidence is a technically feasible and fair zero-trust signal, substantially more reliable than naive correction-counting under the simulated-contributor conditions evaluated here; detecting deliberately stealthy manipulation remains an open problem.

Open Research EuropeVol. 6
Polytechnic University of Puerto Rico (PR), Universidad de Salamanca (ES), Technological Institute of Castilla y León (ES), Universidad de Zamora (MX)
HORIZON EUROPE Framework Programme
Peace, Justice and strong institutions
Openalex Percentile: Top 14%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.