Tokeniser-Aware Shorthand (TASS): A Stenography-Inspired Output Format for Reducing LLM Inference Cost in Structured Extraction Pipelines

Output serialisation formats designed for human readability—JSON, YAML, even the newer TOON specification—carry structural overhead that is purely an artefact of human-facing conventions. When the consumer is a large language model and the producer is another large language model, those conventions tax every inference call. This paper proposes a stenography-inspired shorthand notation aligned to LLM tokeniser boundaries, achieving a 75–85% reduction in output tokens versus JSON for fixed-schema structured extraction workloads, with parsing complexity equivalent to a single split-and-map operation on the server. The approach is validated against a production rate calculator use case but generalises to any production system performing high-volume, fixed-schema LLM data extraction.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-27
DOI
https://doi.org/10.5281/zenodo.20403218
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Tokeniser-Aware Shorthand (TASS): A Stenography-Inspired Output Format for Reducing LLM Inference Cost in Structured Extraction Pipelines

Sharma Suyash
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
article

Tokeniser-Aware Shorthand (TASS): A Stenography-Inspired Output Format for Reducing LLM Inference Cost in Structured Extraction Pipelines

Sharma Suyash
article en

Abstract

Output serialisation formats designed for human readability—JSON, YAML, even the newer TOON specification—carry structural overhead that is purely an artefact of human-facing conventions. When the consumer is a large language model and the producer is another large language model, those conventions tax every inference call. This paper proposes a stenography-inspired shorthand notation aligned to LLM tokeniser boundaries, achieving a 75–85% reduction in output tokens versus JSON for fixed-schema structured extraction workloads, with parsing complexity equivalent to a single split-and-map operation on the server. The approach is validated against a production rate calculator use case but generalises to any production system performing high-volume, fixed-schema LLM data extraction.

Zenodo (CERN European Organization for Nuclear Research)
Decent work and economic growth
Openalex Percentile: Top 6%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.