PQID-Bench 2: Preregistered Evaluation of Semantic Validity, Structural Divergence, and Algorithm-Family Effects.

PQID-Bench 2 is a prospective, preregistered extension of PQID-Bench for evaluating whether executable and OpenQASM 3-admissible LLM-generated quantum programs preserve task-level semantics. Its primary objective is to test for and estimate the prevalence of Semantic Void: executable outputs that fail a frozen, independently validated semantic oracle. The study will distinguish semantic failure from semantically valid structural divergence and conduct secondary preregistered contrasts across canonical quantum-algorithm families, audited task scopes, and name-visible versus name-masked prompts. Prompt eligibility, semantic oracles, model and provider routes, analysis procedures, multiplicity controls, and artifact hashes will be frozen before any PQID-Bench 2 API calls. Existing PQID-Bench results motivate the design but will not be reanalyzed as confirmatory PQID-Bench 2 evidence.

Authors

Publication Details

Journal
Open Science Framework
Published
2026-07-28
DOI
https://doi.org/10.17605/osf.io/wderq
Primary Topic
Quantum Computing Algorithms and Architecture
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PQID-Bench 2: Preregistered Evaluation of Semantic Validity, Structural Divergence, and Algorithm-Family Effects.

Elias Abebe Gasparini
Open Science Framework
Quantum Computing Algorithms and Architecture
article

PQID-Bench 2: Preregistered Evaluation of Semantic Validity, Structural Divergence, and Algorithm-Family Effects.

Elias Abebe Gasparini
article en

Abstract

PQID-Bench 2 is a prospective, preregistered extension of PQID-Bench for evaluating whether executable and OpenQASM 3-admissible LLM-generated quantum programs preserve task-level semantics. Its primary objective is to test for and estimate the prevalence of Semantic Void: executable outputs that fail a frozen, independently validated semantic oracle. The study will distinguish semantic failure from semantically valid structural divergence and conduct secondary preregistered contrasts across canonical quantum-algorithm families, audited task scopes, and name-visible versus name-masked prompts. Prompt eligibility, semantic oracles, model and provider routes, analysis procedures, multiplicity controls, and artifact hashes will be frozen before any PQID-Bench 2 API calls. Existing PQID-Bench results motivate the design but will not be reanalyzed as confirmatory PQID-Bench 2 evidence.

Open Science Framework
Openalex Percentile: Top 6%
Quantum Computing Algorithms and Architecture
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.