Uncertainty-aware Bayesian federated learning for low-resource neural machine translation at the edge

Edge translation systems must balance limited computation, data locality, and weak performance on low-resource language pairs. This study presents Multitask Bayesian Federated Learning (MT-BayesFL), a multilingual translation framework that combines a lightweight shared encoder, task-specific decoders, matrix-normal posteriors over shared attention projections, and covariance-aware server aggregation. Client-side variational inference estimates posterior statistics that are fused by positive-semidefinite mixture moment matching, while Top-K transmission and KL regularization support communication-efficient training under non-IID data. An optional client-level differential-privacy release is defined only for a trusted or secure aggregation boundary and is reported as conditional privacy accounting rather than as part of the individual-update reconstruction diagnostic. Across five English-to-X tasks, MT-BayesFL is not uniformly strongest on high-resource pairs, where AdapterFL yields higher BLEU for English-Chinese, English-French, and English-German. Its largest descriptive advantages occur on English-Russian and English-Swahili, with BLEU scores of 32.6 and 28.3, respectively, together with an ECE of 0.082 on English-Swahili, 92.1% performance retention at 30% device dropout, a 1.786 MB upload per participating client per round, and lower reconstruction fidelity in the disclosed single-sentence no-DP diagnostic (TRA = 0.12; CosSim = 0.31). Under the separately specified aggregate release, the verified privacy accountant gives epsilon = 12.53 at delta = 0.00001; no end-to-end privacy-utility claim is made for that optional path.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-09-14
DOI
https://doi.org/10.1038/s41598-026-71065-5
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Uncertainty-aware Bayesian federated learning for low-resource neural machine translation at the edge

Na Yao, Xin Yang, Feng Xiao
Scientific Reports
Privacy-Preserving Technologies in Data
article

Uncertainty-aware Bayesian federated learning for low-resource neural machine translation at the edge

Na Yao, Xin Yang, Feng Xiao
article en

Abstract

Edge translation systems must balance limited computation, data locality, and weak performance on low-resource language pairs. This study presents Multitask Bayesian Federated Learning (MT-BayesFL), a multilingual translation framework that combines a lightweight shared encoder, task-specific decoders, matrix-normal posteriors over shared attention projections, and covariance-aware server aggregation. Client-side variational inference estimates posterior statistics that are fused by positive-semidefinite mixture moment matching, while Top-K transmission and KL regularization support communication-efficient training under non-IID data. An optional client-level differential-privacy release is defined only for a trusted or secure aggregation boundary and is reported as conditional privacy accounting rather than as part of the individual-update reconstruction diagnostic. Across five English-to-X tasks, MT-BayesFL is not uniformly strongest on high-resource pairs, where AdapterFL yields higher BLEU for English-Chinese, English-French, and English-German. Its largest descriptive advantages occur on English-Russian and English-Swahili, with BLEU scores of 32.6 and 28.3, respectively, together with an ECE of 0.082 on English-Swahili, 92.1% performance retention at 30% device dropout, a 1.786 MB upload per participating client per round, and lower reconstruction fidelity in the disclosed single-sentence no-DP diagnostic (TRA = 0.12; CosSim = 0.31). Under the separately specified aggregate release, the verified privacy accountant gives epsilon = 12.53 at delta = 0.00001; no end-to-end privacy-utility claim is made for that optional path.

Scientific Reports
Anhui Business College (CN), Anhui Xinhua University (CN)
Quality Education
Openalex Percentile: Top 8%
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Uncertainty-aware Bayesian federated learning for low-resource neural machine translation at the edge — Na Yao, Xin Yang, et al. · Scientific Reports (2026) | TGRS Research Map | TGRS