Note on the Equivalence of Orthogonalizing EM and Proximal Gradient Descent

Xiong et al. (2016) develop a method called orthogonalizing EM (OEM) to solve penalized regression problems for tall data. While OEM is developed in the context of the EM algorithm, we show that it is, in fact, an instance of proximal gradient descent, a popular first-order convex optimization algorithm.

Authors

Institutions

Publication Details

Journal
Technometrics
Published
2024-11-19
DOI
https://doi.org/10.1080/00401706.2024.2430204
Primary Topic
Sparse and Compressive Sensing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Note on the Equivalence of Orthogonalizing EM and Proximal Gradient Descent

James Yang, Trevor Hastie
Technometrics
Sparse and Compressive Sensing Techniques
article

Note on the Equivalence of Orthogonalizing EM and Proximal Gradient Descent

James Yang, Trevor Hastie
article en

Abstract

Xiong et al. (2016) develop a method called orthogonalizing EM (OEM) to solve penalized regression problems for tall data. While OEM is developed in the context of the EM algorithm, we show that it is, in fact, an instance of proximal gradient descent, a popular first-order convex optimization algorithm.

TechnometricsVol. 67(2)
Stanford University (US)
National Science Foundation, National Institutes of Health
Openalex Percentile: Top 77%
Sparse and Compressive Sensing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.