Suggestible Judges: data, code and manuscript

Data, code and manuscript for the paper Suggestible Judges Show Asymmetric Deference to Negative Labels in Large Language Model Adjudication. Three LLM judges (Claude Opus 4.7, GPT-5.5, Gemini 3.5 Flash) adjudicated annotator disagreements on SEC 10-K knowledge-graph edges with and without annotator labels in the prompt, including a randomly assigned synthetic label. The archive contains every per-pair verdict log, the disagreement pairs with both annotators' labels, the experiment harness, all analysis scripts, and the LaTeX source and compiled manuscript. Code is MIT-licensed; text and data are CC BY 4.0; ChaosNLI items keep their CC BY-NC 4.0 license. The full annotation sets, which are the evaluation data of a separate manuscript, are withheld; aggregate counts are included.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-26
DOI
https://doi.org/10.5281/zenodo.23660833
Primary Topic
Artificial Intelligence in Law
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Suggestible Judges: data, code and manuscript

Gaurav Vishnu Londhe, Rachit Garg, Anshul Gupta, Dhruvish Shah et al.
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Law
article

Suggestible Judges: data, code and manuscript

Gaurav Vishnu Londhe, Rachit Garg, Anshul Gupta, Dhruvish Shah, Divyansh Maiwar Singh
article en

Abstract

Data, code and manuscript for the paper Suggestible Judges Show Asymmetric Deference to Negative Labels in Large Language Model Adjudication. Three LLM judges (Claude Opus 4.7, GPT-5.5, Gemini 3.5 Flash) adjudicated annotator disagreements on SEC 10-K knowledge-graph edges with and without annotator labels in the prompt, including a randomly assigned synthetic label. The archive contains every per-pair verdict log, the disagreement pairs with both annotators' labels, the experiment harness, all analysis scripts, and the LaTeX source and compiled manuscript. Code is MIT-licensed; text and data are CC BY 4.0; ChaosNLI items keep their CC BY-NC 4.0 license. The full annotation sets, which are the evaluation data of a separate manuscript, are withheld; aggregate counts are included.

Zenodo (CERN European Organization for Nuclear Research)
Symbiosis International University (IN), S P Jain School of Global Management (AE)
Openalex Percentile: Top 4%
Artificial Intelligence in Law
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon