Idemcore: Bit-Identical LLM Inference from Phones to Datacenter GPUs, with an Open Per-Token Verification Protocol

Two correct floating-point LLM engines rarely return the same bits, so a third party cannot check an inference result except by trusting a tolerance. This preprint presents Idemcore, an integer-only engine for transformer inference, together with an open verification protocol: every decoding step emits a 64-bit hash of the full-vocabulary integer logits and a hash of the integer cumulative distribution used for sampling. Anyone can re-run a request on hardware they control and compare logs line by line. We report full-model, end-to-end bit identity across x86-64 CPUs, a Windows 11 ARM64 laptop, an Android phone and five NVIDIA GPU models (T4, A10, A10G, L40S, H100) for Qwen2.5-0.5B, Qwen2.5-7B (8- and 4-bit) and gpt-oss-20b/120b. On a same-harness H100 serving benchmark of Qwen2.5-7B (1 November 2026), Idemcore serves 2729–4008 tok/s aggregate at 32–256 concurrent requests; vLLM and SGLang are faster today. Idemcore trades throughput for bit-identical output and per-token hash receipts at every batch size. The verifier (Apache-2.0), log specification, methodology and sample logs will be released at https://idemcore.net; the inference engine itself is closed.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-01
DOI
https://doi.org/10.5281/zenodo.23851128
Primary Topic
Natural Language Processing Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Idemcore: Bit-Identical LLM Inference from Phones to Datacenter GPUs, with an Open Per-Token Verification Protocol

Don Wick
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
preprint

Idemcore: Bit-Identical LLM Inference from Phones to Datacenter GPUs, with an Open Per-Token Verification Protocol

Don Wick
preprint en

Abstract

Two correct floating-point LLM engines rarely return the same bits, so a third party cannot check an inference result except by trusting a tolerance. This preprint presents Idemcore, an integer-only engine for transformer inference, together with an open verification protocol: every decoding step emits a 64-bit hash of the full-vocabulary integer logits and a hash of the integer cumulative distribution used for sampling. Anyone can re-run a request on hardware they control and compare logs line by line. We report full-model, end-to-end bit identity across x86-64 CPUs, a Windows 11 ARM64 laptop, an Android phone and five NVIDIA GPU models (T4, A10, A10G, L40S, H100) for Qwen2.5-0.5B, Qwen2.5-7B (8- and 4-bit) and gpt-oss-20b/120b. On a same-harness H100 serving benchmark of Qwen2.5-7B (1 November 2026), Idemcore serves 2729–4008 tok/s aggregate at 32–256 concurrent requests; vLLM and SGLang are faster today. Idemcore trades throughput for bit-identical output and per-token hash receipts at every batch size. The verifier (Apache-2.0), log specification, methodology and sample logs will be released at https://idemcore.net; the inference engine itself is closed.

Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon