LPBench: A Lean Benchmark for Research-Level Mathematical Theorem Proving

In October 2026, OpenAI released hundreds of manuscripts resolving open mathematical problems, without publishing the full set of problems attempted by its model. Assessing the broader capabilities and limitations of such systems calls for independent benchmarks. To this end, we introduce LPBench, a benchmark for research-level mathematics comprising 117 problems formalised in Lean 4, primarily in combinatorics and graph theory. As a first application, we evaluate Claude Opus 5.5 and Claude Fable 5.1, each with and without web search. Website: https://lp-bench.github.io/

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-13
DOI
https://doi.org/10.5281/zenodo.24195211
Primary Topic
Mathematics, Computing, and Information Processing
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

LPBench: A Lean Benchmark for Research-Level Mathematical Theorem Proving

Sven Groppe, Johannes Carmesin, Jinghua Groppe, Utku Okur et al.
Zenodo (CERN European Organization for Nuclear Research)
Mathematics, Computing, and Information Processing
preprint

LPBench: A Lean Benchmark for Research-Level Mathematical Theorem Proving

Sven Groppe, Johannes Carmesin, Jinghua Groppe, Utku Okur, Nathan Bowler, Vaibhav Bajpai
preprint en

Abstract

In October 2026, OpenAI released hundreds of manuscripts resolving open mathematical problems, without publishing the full set of problems attempted by its model. Assessing the broader capabilities and limitations of such systems calls for independent benchmarks. To this end, we introduce LPBench, a benchmark for research-level mathematics comprising 117 problems formalised in Lean 4, primarily in combinatorics and graph theory. As a first application, we evaluate Claude Opus 5.5 and Claude Fable 5.1, each with and without web search. Website: https://lp-bench.github.io/

Zenodo (CERN European Organization for Nuclear Research)
Universität Hamburg (DE), TU Bergakademie Freiberg (DE)
Mathematics, Computing, and Information Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon