ADAM-TPU: Rotation as a Shared Hardware Primitive for Analog LLM Inference

This paper presents a position and architecture proposal for ADAM-TPU, a non-von Neumann tensorial core optimized for Large Language Model (LLM) serving on a complex-polar analog substrate. We demonstrate that a single physical primitive—a programmable unitary rotation engine—underlies three otherwise separate problems in transformer optimization: rotary positional encoding (RoPE), inner-product-preserving similarity via Johnson-Lindenstrauss projections, and near-optimal KV-cache quantization. By combining a coherent photonic Mach-Zehnder interferometer (MZI) mesh for orthogonal rotations with a non-volatile memristive crossbar lattice for diagonal scaling, ADAM-TPU executes low-rank Singular Value Decomposition (SVD) factorizations in constant physical settling time. This unified approach directly resolves the traditional analog noise floor bottleneck (~6-8 bits); since rotation-based quantization algorithms achieve quality-neutral long-context retrieval at 2.5–3.5 bits per channel, the hardware error budget easily sits inside what the optical primitives provide for free. The architecture is paired with a static VLIW front-end, a recurrent low-rank context state, and a hardware-enforced measured-boot attestation layer for execution integrity. Known physical boundaries—including the ADC/DAC conversion wall, conductance drift, and the scale constraints of in-memory eigensolving—are systematically mapped in an explicit "Socratic Tail." Released under the Systemic Verification Engineering (S.V.E.) Meta-License v4.0 (share-alike).

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-28
DOI
https://doi.org/10.5281/zenodo.20433698
Primary Topic
Neural Networks and Reservoir Computing
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

ADAM-TPU: Rotation as a Shared Hardware Primitive for Analog LLM Inference

Artiom Kovnatsky
Zenodo (CERN European Organization for Nuclear Research)
Neural Networks and Reservoir Computing
preprint

ADAM-TPU: Rotation as a Shared Hardware Primitive for Analog LLM Inference

Artiom Kovnatsky
preprint en

Abstract

This paper presents a position and architecture proposal for ADAM-TPU, a non-von Neumann tensorial core optimized for Large Language Model (LLM) serving on a complex-polar analog substrate. We demonstrate that a single physical primitive—a programmable unitary rotation engine—underlies three otherwise separate problems in transformer optimization: rotary positional encoding (RoPE), inner-product-preserving similarity via Johnson-Lindenstrauss projections, and near-optimal KV-cache quantization. By combining a coherent photonic Mach-Zehnder interferometer (MZI) mesh for orthogonal rotations with a non-volatile memristive crossbar lattice for diagonal scaling, ADAM-TPU executes low-rank Singular Value Decomposition (SVD) factorizations in constant physical settling time. This unified approach directly resolves the traditional analog noise floor bottleneck (~6-8 bits); since rotation-based quantization algorithms achieve quality-neutral long-context retrieval at 2.5–3.5 bits per channel, the hardware error budget easily sits inside what the optical primitives provide for free. The architecture is paired with a static VLIW front-end, a recurrent low-rank context state, and a hardware-enforced measured-boot attestation layer for execution integrity. Known physical boundaries—including the ADC/DAC conversion wall, conductance drift, and the scale constraints of in-memory eigensolving—are systematically mapped in an explicit "Socratic Tail." Released under the Systemic Verification Engineering (S.V.E.) Meta-License v4.0 (share-alike).

Zenodo (CERN European Organization for Nuclear Research)
Laboratoire Spécification et Vérification (FR)
Neural Networks and Reservoir Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.