Suggestible Judges: data, code and manuscript
Data, code and manuscript for the paper Suggestible Judges Show Asymmetric Deference to Negative Labels in Large Language Model Adjudication. Three LLM judges (Claude Opus 4.7, GPT-5.5, Gemini 3.5 Flash) adjudicated annotator disagreements on SEC 10-K knowledge-graph edges with and without annotator labels in the prompt, including a randomly assigned synthetic label. The archive contains every per-pair verdict log, the disagreement pairs with both annotators' labels, the experiment harness, all analysis scripts, and the LaTeX source and compiled manuscript. Code is MIT-licensed; text and data are CC BY 4.0; ChaosNLI items keep their CC BY-NC 4.0 license. The full annotation sets, which are the evaluation data of a separate manuscript, are withheld; aggregate counts are included.
Authors
- Gaurav Vishnu Londhe (ORCID: https://orcid.org/0000-0001-9084-5733)
- Rachit Garg (ORCID: https://orcid.org/0000-0002-2996-5530)
- Anshul Gupta
- Dhruvish Shah
- Divyansh Maiwar Singh
Institutions
- Symbiosis International University (IN)
- S P Jain School of Global Management (AE)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-10-26
- DOI
- https://doi.org/10.5281/zenodo.23660833
- Primary Topic
- Artificial Intelligence in Law
- Type
- article
- Field-Weighted Citation Impact
- 0.00