Causal Whitespace Patching for Korean Byte-Latent Language Models: Quality-Preserving Latency and the Limits of Scale Amplification

Byte-latent language models amortize global Transformer compute by grouping raw bytes into patches, but fewer patches need not preserve quality or reduce end-to-end latency. This study tests causal whitespace-informed patching on Korean in identical byte-latent graphs, separating boundary placement, patch rate, learned-router cost, and cached autoregressive time-to-output. At 19.6M parameters, the quality-matched whitespace policy reduced controlled end-to-end latency by 2.628% and strict-valid free-running latency by 2.531% relative to the C86 codepoint baseline. At 188.6M parameters, a quality-rescued W80 replication reduced controlled latency by 2.887% and free-running latency by 2.475%. The prespecified 10% target was not met, and model size did not amplify the percentage gain. The result is therefore a bounded positive systems finding and a negative scale-amplification finding, not a general 10% speedup or a production-ready Korean LLM. This open record contains the named preprint, self-contained arXiv source, curated reproducibility bundle, citation metadata, and SHA-256 checksums. It excludes raw corpora, model checkpoints, record identifiers, raw generated outputs, and per-sequence loss arrays. Code and reproducibility materials are Apache-2.0; the paper is CC BY 4.0.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-17
DOI
https://doi.org/10.5281/zenodo.21973009
Primary Topic
Natural Language Processing Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Causal Whitespace Patching for Korean Byte-Latent Language Models: Quality-Preserving Latency and the Limits of Scale Amplification

황경찬
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
preprint

Causal Whitespace Patching for Korean Byte-Latent Language Models: Quality-Preserving Latency and the Limits of Scale Amplification

황경찬
preprint en

Abstract

Byte-latent language models amortize global Transformer compute by grouping raw bytes into patches, but fewer patches need not preserve quality or reduce end-to-end latency. This study tests causal whitespace-informed patching on Korean in identical byte-latent graphs, separating boundary placement, patch rate, learned-router cost, and cached autoregressive time-to-output. At 19.6M parameters, the quality-matched whitespace policy reduced controlled end-to-end latency by 2.628% and strict-valid free-running latency by 2.531% relative to the C86 codepoint baseline. At 188.6M parameters, a quality-rescued W80 replication reduced controlled latency by 2.887% and free-running latency by 2.475%. The prespecified 10% target was not met, and model size did not amplify the percentage gain. The result is therefore a bounded positive systems finding and a negative scale-amplification finding, not a general 10% speedup or a production-ready Korean LLM. This open record contains the named preprint, self-contained arXiv source, curated reproducibility bundle, citation metadata, and SHA-256 checksums. It excludes raw corpora, model checkpoints, record identifiers, raw generated outputs, and per-sequence loss arrays. Code and reproducibility materials are Apache-2.0; the paper is CC BY 4.0.

Zenodo (CERN European Organization for Nuclear Research)
Public Risk Management Association (US)
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.