AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification

Extreme quantization restricts Transformer weights to the ternary set {−1,0,+1}, but whether this transfers to morphologically rich languages is untested. Arabic is demanding, because its clitic-heavy, root-and-pattern morphology yields a vast inventory of surface forms that subword tokenizers segment at linguistically meaningless boundaries. AraBit-1.58 couples a Morphology-Aware Tokenization and Embedding layer (MATE) with a BitNet b1.58 ternary backbone. MATE decomposes each word into proclitics, root, morphosemantic pattern, and enclitics, embeds these separately, and gates to a subword fallback when analysis fails. We evaluate on the SAMER Arabic simplification corpus under a controlled two-by-two design over three seeds that varies only the front end and the weight precision. Ternary quantization compresses weight memory 2.85×, from 104.72 to 36.70 MB, but without a fused ternary kernel it cuts neither latency nor energy. The comparison confirms our pre-specified hypothesis: quantization costs 9.43 SARI with subword input against 7.49 SARI with morphological input, an interaction of +1.93 SARI significant across seeds (paired t(2) =4.55, one-tailed p=0.023). Morphological grounding therefore buys robustness to extreme quantization rather than higher absolute quality, measured on SARI at small scale.

Authors

Institutions

Publication Details

Journal
Islamic University Journal of Applied Sciences
Published
2026-10-30
DOI
https://doi.org/10.63070/jesc.2026.047
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification

Abdullah M. Alshanqiti
1 links
Islamic University Journal of Applied Sciences
Natural Language Processing Techniques
article

AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification

Abdullah M. Alshanqiti
article en

Abstract

Extreme quantization restricts Transformer weights to the ternary set {−1,0,+1}, but whether this transfers to morphologically rich languages is untested. Arabic is demanding, because its clitic-heavy, root-and-pattern morphology yields a vast inventory of surface forms that subword tokenizers segment at linguistically meaningless boundaries. AraBit-1.58 couples a Morphology-Aware Tokenization and Embedding layer (MATE) with a BitNet b1.58 ternary backbone. MATE decomposes each word into proclitics, root, morphosemantic pattern, and enclitics, embeds these separately, and gates to a subword fallback when analysis fails. We evaluate on the SAMER Arabic simplification corpus under a controlled two-by-two design over three seeds that varies only the front end and the weight precision. Ternary quantization compresses weight memory 2.85×, from 104.72 to 36.70 MB, but without a fused ternary kernel it cuts neither latency nor energy. The comparison confirms our pre-specified hypothesis: quantization costs 9.43 SARI with subword input against 7.49 SARI with morphological input, an interaction of +1.93 SARI significant across seeds (paired t(2) =4.55, one-tailed p=0.023). Morphological grounding therefore buys robustness to extreme quantization rather than higher absolute quality, measured on SARI at small scale.

Islamic University Journal of Applied SciencesVol. VIII(2)
Islamic University of Madinah (SA)
Openalex Percentile: Top 14%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon