Beyond Jensen’s Inequality: Speeding Up ML Estimation of Generalized Hyperbolic Distributions

The generalized hyperbolic (GH) distribution is a highly flexible probability distribution that finds applications in various fields, yet estimating its parameters is quite challenging. This paper focuses on the maximum likelihood (ML) estimation of the GH distribution. In the literature, several expectation-maximization (EM) type algorithms have been proposed, which iteratively optimize a surrogate objective called the Q-function—a tractable lower bound of the likelihood function. While these generic EM-type algorithms, derived based on Jensen’s inequality, provide a systematic framework, they often restrict flexibility in algorithm design. In this study, we adopt the block minorization-maximization (BMM) framework, a more general iterative surrogate maximization approach that subsumes EM-type algorithms as special cases, to address the ML estimation problem. We propose efficient, problem-specific algorithms that utilize novel surrogate functions, which provide a provably tighter surrogate function on the likelihood than the Q-function while still allowing for closed-form updates. As a result, the proposed algorithm achieves faster and guaranteed convergence. Numerical experiments on synthetic data confirm the superior convergence speed of our algorithms compared to existing ones.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10888150
Primary Topic
Bayesian Methods and Mixture Models
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond Jensen’s Inequality: Speeding Up ML Estimation of Generalized Hyperbolic Distributions

Ziping Zhao, Chenyu Gao
Bayesian Methods and Mixture Models
article

Beyond Jensen’s Inequality: Speeding Up ML Estimation of Generalized Hyperbolic Distributions

Ziping Zhao, Chenyu Gao
article en

Abstract

The generalized hyperbolic (GH) distribution is a highly flexible probability distribution that finds applications in various fields, yet estimating its parameters is quite challenging. This paper focuses on the maximum likelihood (ML) estimation of the GH distribution. In the literature, several expectation-maximization (EM) type algorithms have been proposed, which iteratively optimize a surrogate objective called the Q-function—a tractable lower bound of the likelihood function. While these generic EM-type algorithms, derived based on Jensen’s inequality, provide a systematic framework, they often restrict flexibility in algorithm design. In this study, we adopt the block minorization-maximization (BMM) framework, a more general iterative surrogate maximization approach that subsumes EM-type algorithms as special cases, to address the ML estimation problem. We propose efficient, problem-specific algorithms that utilize novel surrogate functions, which provide a provably tighter surrogate function on the likelihood than the Q-function while still allowing for closed-form updates. As a result, the proposed algorithm achieves faster and guaranteed convergence. Numerical experiments on synthetic data confirm the superior convergence speed of our algorithms compared to existing ones.

ShanghaiTech University (CN)
Nature
Reduced inequalities
Openalex Percentile: Top 98%
Bayesian Methods and Mixture Models
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Beyond Jensen’s Inequality: Speeding Up ML Estimation of Generalized Hyperbolic Distributions — Ziping Zhao, Chenyu Gao · (2025) | TGRS Research Map | TGRS