Byzantine-Robust Sparse Regression with Missing Covariates

We study distributed sparse linear regression with missing covariates and Byzantine workers. Correcting for missing observations can make the regression loss nonconvex, while Byzantine reports can distort gradient updates and impair estimation. A communication-efficient method is proposed that combines robust gradient aggregation with folded-concave regularization. Under appropriate regularity conditions, after $t$ communication rounds the estimation error is bounded by a transient component determined by the initial error and decaying geometrically with $t$, plus a residual component reflecting finite-sample variability and Byzantine contamination. Simulations and two real-data examples evaluate estimation accuracy, variable selection, and communication costs.

Authors

Publication Details

Journal
arXiv (Cornell University)
Published
2026-10-26
DOI
https://doi.org/10.48550/arxiv.2610.35321
Primary Topic
Statistical Methods and Inference
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Byzantine-Robust Sparse Regression with Missing Covariates

Rongmei Liang, Jian Shi, Xiaofei Wu
arXiv (Cornell University)
Statistical Methods and Inference
preprint

Byzantine-Robust Sparse Regression with Missing Covariates

Rongmei Liang, Jian Shi, Xiaofei Wu
preprint en

Abstract

We study distributed sparse linear regression with missing covariates and Byzantine workers. Correcting for missing observations can make the regression loss nonconvex, while Byzantine reports can distort gradient updates and impair estimation. A communication-efficient method is proposed that combines robust gradient aggregation with folded-concave regularization. Under appropriate regularity conditions, after $t$ communication rounds the estimation error is bounded by a transient component determined by the initial error and decaying geometrically with $t$, plus a residual component reflecting finite-sample variability and Byzantine contamination. Simulations and two real-data examples evaluate estimation accuracy, variable selection, and communication costs.

arXiv (Cornell University)
Statistical Methods and Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon