A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences

While progress has been made in legal applications, law reasoning, crucial for fair adjudication, remains unexplored.We propose a transparent law reasoning schema enriched with hierarchical factum probandum, evidence, and implicit experience, enabling public scrutiny and preventing bias.Inspired by this schema, we introduce the challenging task, which takes a textual case description and outputs a hierarchical structure justifying the final decision.We also create the first crowd-sourced dataset for this task, enabling comprehensive evaluation.Simultaneously, we propose an agent framework that employs a comprehensive suite of legal analysis tools to address the challenge task.This benchmark paves the way for transparent and accountable AI-assisted law reasoning in the "Intelligent Court" 1 .

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.887
Primary Topic
Law, Economics, and Judicial Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences

Fandong Meng, Fei Zheng, Lie Lin, Jie Zhou et al.
Law, Economics, and Judicial Systems
article

A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences

Fandong Meng, Fei Zheng, Lie Lin, Jie Zhou, Wenjuan Han, Jinan Xu, Guoyang Ma, Jiaxin Shen, Huiqi Hu
article en

Abstract

While progress has been made in legal applications, law reasoning, crucial for fair adjudication, remains unexplored.We propose a transparent law reasoning schema enriched with hierarchical factum probandum, evidence, and implicit experience, enabling public scrutiny and preventing bias.Inspired by this schema, we introduce the challenging task, which takes a textual case description and outputs a hierarchical structure justifying the final decision.We also create the first crowd-sourced dataset for this task, enabling comprehensive evaluation.Simultaneously, we propose an agent framework that employs a comprehensive suite of legal analysis tools to address the challenge task.This benchmark paves the way for transparent and accountable AI-assisted law reasoning in the "Intelligent Court" 1 .

China Railway, National Natural Science Foundation of China
Peace, Justice and strong institutions
Openalex Percentile: Top 73%
Law, Economics, and Judicial Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences — Fandong Meng, Fei Zheng, et al. · (2025) | TGRS Research Map | TGRS