Efficiency Is Not Language-Neutral: Per-Language Auditing and Calibration of Multilingual Dense Retrieval

Production dense retrieval trades accuracy for efficiency: vectors are compressed, search is approximate, and thresholds filter results, each tuned by mean quality. In a multilingual index, one configuration serves every language, so losses on a few can hide behind a healthy mean. This practice-oriented empirical study audits that efficiency layer per language, separating hidden losses from sampling noise and generic fragility, across eight embedding models, three test beds, indexes of up to 4,978,232 passages, and five vector databases. The mean hides the worst-served language beyond noise in 339 of 474 compression configurations; with BGE-M3 and 16-byte product codes, mean retention is 0.767, but romanized Bengali keeps 0.228. Vector databases at documented settings hide it in 26 of 27 settings with a mean retention of at least 0.95, and the loss reaches downstream answers. Trained product quantizers concentrate error beyond matched noise, whereas dequantized int8 is nearly lossless for every language. The study offers a reusable audit protocol, a per-language map of safe configurations, and per-language calibration with finite-sample guarantees that keeps every language within target in all 464 settings; marginal and per-query calibration fail in 325 and 300. Efficiency in multilingual retrieval should be measured, and calibrated, per language.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-27
DOI
https://doi.org/10.5281/zenodo.23703002
Primary Topic
Information Retrieval and Search Behavior
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Efficiency Is Not Language-Neutral: Per-Language Auditing and Calibration of Multilingual Dense Retrieval

Muhammad Wahyu Arga
Zenodo (CERN European Organization for Nuclear Research)
Information Retrieval and Search Behavior
preprint

Efficiency Is Not Language-Neutral: Per-Language Auditing and Calibration of Multilingual Dense Retrieval

Muhammad Wahyu Arga
preprint en

Abstract

Production dense retrieval trades accuracy for efficiency: vectors are compressed, search is approximate, and thresholds filter results, each tuned by mean quality. In a multilingual index, one configuration serves every language, so losses on a few can hide behind a healthy mean. This practice-oriented empirical study audits that efficiency layer per language, separating hidden losses from sampling noise and generic fragility, across eight embedding models, three test beds, indexes of up to 4,978,232 passages, and five vector databases. The mean hides the worst-served language beyond noise in 339 of 474 compression configurations; with BGE-M3 and 16-byte product codes, mean retention is 0.767, but romanized Bengali keeps 0.228. Vector databases at documented settings hide it in 26 of 27 settings with a mean retention of at least 0.95, and the loss reaches downstream answers. Trained product quantizers concentrate error beyond matched noise, whereas dequantized int8 is nearly lossless for every language. The study offers a reusable audit protocol, a per-language map of safe configurations, and per-language calibration with finite-sample guarantees that keeps every language within target in all 464 settings; marginal and per-query calibration fail in 325 and 300. Efficiency in multilingual retrieval should be measured, and calibrated, per language.

Zenodo (CERN European Organization for Nuclear Research)
Shahjalal University of Science and Technology (BD)
Information Retrieval and Search Behavior
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon