"Hallucination" Is Not Enough: Why Legal LLM Benchmarks Should Measure "Correctly Grounded"

Legal benchmarks of large language models (LLMs) commonly report a "hallucination rate". The most influential operationalisation, by Magesh et al. (2025), decomposes factual hallucination into correctness and groundedness and labels a response as hallucinated when it is incorrect or misgrounded. This paper argues, on the basis of a working benchmark of LLMs on Polish civil procedure (LexAlpha Lab), that the framework does not transfer one-to-one to civil-law systems. Three observations support the claim: (1) the two dimensions overlap on the error types that matter most in statute-based law; (2) a wrong case citation and a wrong statutory content do not carry the same weight where the statute, not the judgment, is the source of law; (3) the currency of the provision's wording, which Polish official sources (ISAP) date precisely, is not measured by any published benchmark with numbers. I propose to replace the binary question "did the model hallucinate?" with "is the answer correctly grounded?", defined as: the cited designation exists, the content attributed to it is really there, and the wording was in force on the date of the question. Preliminary results from 65 answers (10 models without tools, 3 systems with search; 4 model judges, Cohen's κ 0.81–0.93 against the cards before the author's review) are reported, together with the limitations of the pilot and the reasons for keeping the criteria simple enough to re-run on every monthly model release.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-17
DOI
https://doi.org/10.5281/zenodo.23438195
Primary Topic
Artificial Intelligence in Law
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

"Hallucination" Is Not Enough: Why Legal LLM Benchmarks Should Measure "Correctly Grounded"

Adam Piotrowski
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Law
article

"Hallucination" Is Not Enough: Why Legal LLM Benchmarks Should Measure "Correctly Grounded"

Adam Piotrowski
article en

Abstract

Legal benchmarks of large language models (LLMs) commonly report a "hallucination rate". The most influential operationalisation, by Magesh et al. (2025), decomposes factual hallucination into correctness and groundedness and labels a response as hallucinated when it is incorrect or misgrounded. This paper argues, on the basis of a working benchmark of LLMs on Polish civil procedure (LexAlpha Lab), that the framework does not transfer one-to-one to civil-law systems. Three observations support the claim: (1) the two dimensions overlap on the error types that matter most in statute-based law; (2) a wrong case citation and a wrong statutory content do not carry the same weight where the statute, not the judgment, is the source of law; (3) the currency of the provision's wording, which Polish official sources (ISAP) date precisely, is not measured by any published benchmark with numbers. I propose to replace the binary question "did the model hallucinate?" with "is the answer correctly grounded?", defined as: the cited designation exists, the content attributed to it is really there, and the wording was in force on the date of the question. Preliminary results from 65 answers (10 models without tools, 3 systems with search; 4 model judges, Cohen's κ 0.81–0.93 against the cards before the author's review) are reported, together with the limitations of the pilot and the reasons for keeping the criteria simple enough to re-run on every monthly model release.

Zenodo (CERN European Organization for Nuclear Research)
Peace, justice, and strong institutions
Openalex Percentile: Top 4%
Artificial Intelligence in Law
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.