How many chunks fit at 8k/32k/128k: a capacity formula, then summarize
Use floor((context_limit−prompt_tokens−output_reserve)/(chunk_payload_tokens+overhead)) to count chunks at 8k, 32k, 128k; output reserve cuts 8k first. Independent technical note mirroring the canonical version: https://x-oss.com/blog/how-many-chunks-fit-at-8k32k128k-a-capacity-formula-then-summarize.php
Authors
- Wei Chen
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-16
- DOI
- https://doi.org/10.5281/zenodo.24293629
- Primary Topic
- Topic Modeling
- Type
- preprint