The Bias Tax in Long-Context LLM Auditing: Closure Substitution and Verification Overhead under Persona Prompting

This preprint investigates how persona prompting affects reasoning reliability in long-context LLM auditing. We introduce a Logical Needle-in-a-Haystack (L-NIHS) evaluation setup in which models must recover distributed evidence, reject a late-stage distractor, and preserve the correct reasoning path to a numerical closure. Across two independently constructed long-context corpora, four solver families, six prompting conditions, and 2,095 main trials, with an additional 566 inter-judge rescoring trials, we examine how prompt framing influences closure accuracy, evidence use, output characteristics, and downstream verification burden. The results suggest that persona conditioning can distort the final commitment even when relevant evidence has been successfully retrieved, and that such effects vary substantially across models, prompting strategies, and corpus structure. This version is a revised and condensed preprint with updated cross-model experiments, inter-judge validation, and statistical analysis. Supplementary materials, including corpora, prompts, experiment logs, and analysis resources, are linked in the manuscript.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-28
DOI
https://doi.org/10.5281/zenodo.19317680
Primary Topic
Artificial Intelligence in Law
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

The Bias Tax in Long-Context LLM Auditing: Closure Substitution and Verification Overhead under Persona Prompting

Junzhe Cai
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Law
preprint

The Bias Tax in Long-Context LLM Auditing: Closure Substitution and Verification Overhead under Persona Prompting

Junzhe Cai
preprint en

Abstract

This preprint investigates how persona prompting affects reasoning reliability in long-context LLM auditing. We introduce a Logical Needle-in-a-Haystack (L-NIHS) evaluation setup in which models must recover distributed evidence, reject a late-stage distractor, and preserve the correct reasoning path to a numerical closure. Across two independently constructed long-context corpora, four solver families, six prompting conditions, and 2,095 main trials, with an additional 566 inter-judge rescoring trials, we examine how prompt framing influences closure accuracy, evidence use, output characteristics, and downstream verification burden. The results suggest that persona conditioning can distort the final commitment even when relevant evidence has been successfully retrieved, and that such effects vary substantially across models, prompting strategies, and corpus structure. This version is a revised and condensed preprint with updated cross-model experiments, inter-judge validation, and statistical analysis. Supplementary materials, including corpora, prompts, experiment logs, and analysis resources, are linked in the manuscript.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Artificial Intelligence in Law
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Bias Tax in Long-Context LLM Auditing: Closure Substitution and Verification Overhead under Persona Prompting — Junzhe Cai · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS