Inkling 2 Mini vs 27B dense: verifying MoE per-token cost and the batch-size crossover
Inkling 2 Mini beats 27B dense on per-token cost only when batch size ≤ 32; above 64, dense throughput matches its savings. Independent technical note mirroring the canonical version: https://vuti.app/blog/inkling-2-mini-vs-27b-dense-verifying-moe-per-token-cost-and-the-batch-size-crossover.php
Authors
- Lars Bergstrom
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-21
- DOI
- https://doi.org/10.5281/zenodo.24416454
- Primary Topic
- Topic Modeling
- Type
- preprint