RFQ-30: A Synthetic Test Suite for Missing and Conflicting Procurement Inputs

Draft technical note and reproducibility package prepared for Arcforth. RFQ-30 contains 30 AI-assisted synthetic procurement intake cases: ten complete, ten incomplete and ten conflicting. Two deterministic extraction baselines were executed. The first-value baseline matches 230/240 annotated fields but releases ten conflicting requests; the duplicate-aware baseline matches 236/240 fields and still releases four prose-conflict cases. These are descriptive results on a constructed fixture, not operational error estimates. The package includes data, reference labels, code, actual per-case outputs, a frozen local protocol, a data card and limitations. No LLM model was evaluated, no human review time was measured, and no client data or outcomes are included. AI assistance was used in authoring and analysis. Independent practitioner review has not occurred. Corporate authorship and the proposed CC BY 4.0 license require owner confirmation before publication. This draft is not peer reviewed.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-29
DOI
https://doi.org/10.5281/zenodo.23745992
Primary Topic
Public Procurement and Policy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

RFQ-30: A Synthetic Test Suite for Missing and Conflicting Procurement Inputs

Arcforth
2 links
Zenodo (CERN European Organization for Nuclear Research)
Public Procurement and Policy
article

RFQ-30: A Synthetic Test Suite for Missing and Conflicting Procurement Inputs

Arcforth
article en

Abstract

Draft technical note and reproducibility package prepared for Arcforth. RFQ-30 contains 30 AI-assisted synthetic procurement intake cases: ten complete, ten incomplete and ten conflicting. Two deterministic extraction baselines were executed. The first-value baseline matches 230/240 annotated fields but releases ten conflicting requests; the duplicate-aware baseline matches 236/240 fields and still releases four prose-conflict cases. These are descriptive results on a constructed fixture, not operational error estimates. The package includes data, reference labels, code, actual per-case outputs, a frozen local protocol, a data card and limitations. No LLM model was evaluated, no human review time was measured, and no client data or outcomes are included. AI assistance was used in authoring and analysis. Independent practitioner review has not occurred. Corporate authorship and the proposed CC BY 4.0 license require owner confirmation before publication. This draft is not peer reviewed.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 9%
Public Procurement and Policy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon