Sheaf-Theoretic Consistency Measures for Multi-Agent AI: Construction and Empirical Evaluation

This paper asks a simple question about modern AI systems: when you put several models or agents on a task, do their outputs actually cohere into one trustworthy answer — and if not, where, and how much? Standard tooling checks only that the components communicated, not that they agreed. We show that this is, formally, the problem sheaf theory was built for — how local pieces of information glue into a consistent global whole — and we turn that mathematics into a family of computable consistency measures for the outputs of N agents: a fast combinatorial H⁰ disagreement measure, a sheaf-Laplacian "coherence defect," a relational H¹ that detects cyclically frustrated disagreement no pairwise check can see, and a distributional contextuality test. We evaluate them honestly. On graded, relational, and distributional data the measures clearly beat cheap baselines — tracking conflict severity, respecting confidence, localizing the disagreement, and catching cyclic frustration (AUC 1.00) that is invisible to any pairwise statistic. On a discrete multiple-choice task run on a live panel of language models, coherence predicts wrong answers but does not beat simple vote-counting. We report this negative as plainly as the positives: the construction earns its keep on graded, relational, and distributional problems — not one-of-N voting. Code and data are released for reproducibility.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-26
DOI
https://doi.org/10.5281/zenodo.20945474
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Sheaf-Theoretic Consistency Measures for Multi-Agent AI: Construction and Empirical Evaluation

Jack Widman
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

Sheaf-Theoretic Consistency Measures for Multi-Agent AI: Construction and Empirical Evaluation

Jack Widman
preprint en

Abstract

This paper asks a simple question about modern AI systems: when you put several models or agents on a task, do their outputs actually cohere into one trustworthy answer — and if not, where, and how much? Standard tooling checks only that the components communicated, not that they agreed. We show that this is, formally, the problem sheaf theory was built for — how local pieces of information glue into a consistent global whole — and we turn that mathematics into a family of computable consistency measures for the outputs of N agents: a fast combinatorial H⁰ disagreement measure, a sheaf-Laplacian "coherence defect," a relational H¹ that detects cyclically frustrated disagreement no pairwise check can see, and a distributional contextuality test. We evaluate them honestly. On graded, relational, and distributional data the measures clearly beat cheap baselines — tracking conflict severity, respecting confidence, localizing the disagreement, and catching cyclic frustration (AUC 1.00) that is invisible to any pairwise statistic. On a discrete multiple-choice task run on a live panel of language models, coherence predicts wrong answers but does not beat simple vote-counting. We report this negative as plainly as the positives: the construction earns its keep on graded, relational, and distributional problems — not one-of-N voting. Code and data are released for reproducibility.

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.