Approximating evidence via bounded harmonic means

Efficient Bayesian model selection relies on the model evidence or marginal likelihood, whose computation often requires evaluating an intractable integral. The harmonic mean estimator (HME) has long been a standard method of approximating the evidence. While computationally simple, the version introduced by Newton and Raftery (1994) potentially suffers from infinite variance. To overcome this issue, Gelfand and Dey (1994) defined a standardized representation of the estimator based on an instrumental function and Robert and Wraith (2009) later proposed to use higher posterior density (HPD) indicators as instrumental functions. Following this approach, a practical method is proposed, based on an elliptical covering of the HPD region with non-overlapping ellipsoids. The resulting estimator, called the Elliptical Covering Marginal Likelihood Estimator (ECMLE), not only eliminates the infinite-variance issue of the original HME and allows exact volume computations, but is also able to be used in multimodal settings. Through several examples, we illustrate that ECMLE outperforms other recent methods such as THAMES and its improved version (Metodiev et al. 2025). Moreover, ECMLE demonstrates lower variance-a key challenge that subsequent HME variants have sought to address-and provides more stable evidence approximations, even in challenging settings. Supplementary Information: The online version contains supplementary material available at 10.1007/s11222-026-10875-z.

Authors

Institutions

Publication Details

Journal
Statistics and Computing
Published
2026-04-17
DOI
https://doi.org/10.1007/s11222-026-10875-z
Primary Topic
Statistical Methods and Bayesian Inference
Type
article
Field-Weighted Citation Impact
29.32

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Approximating evidence via bounded harmonic means

Kaniav Kamary, Christian P. Robert, Darren Wraith§, Dana Naderi
Statistics and Computing
Statistical Methods and Bayesian Inference
29.32
article

Approximating evidence via bounded harmonic means

Kaniav Kamary, Christian P. Robert, Darren Wraith§, Dana Naderi
article en

Abstract

Efficient Bayesian model selection relies on the model evidence or marginal likelihood, whose computation often requires evaluating an intractable integral. The harmonic mean estimator (HME) has long been a standard method of approximating the evidence. While computationally simple, the version introduced by Newton and Raftery (1994) potentially suffers from infinite variance. To overcome this issue, Gelfand and Dey (1994) defined a standardized representation of the estimator based on an instrumental function and Robert and Wraith (2009) later proposed to use higher posterior density (HPD) indicators as instrumental functions. Following this approach, a practical method is proposed, based on an elliptical covering of the HPD region with non-overlapping ellipsoids. The resulting estimator, called the Elliptical Covering Marginal Likelihood Estimator (ECMLE), not only eliminates the infinite-variance issue of the original HME and allows exact volume computations, but is also able to be used in multimodal settings. Through several examples, we illustrate that ECMLE outperforms other recent methods such as THAMES and its improved version (Metodiev et al. 2025). Moreover, ECMLE demonstrates lower variance-a key challenge that subsequent HME variants have sought to address-and provides more stable evidence approximations, even in challenging settings. Supplementary Information: The online version contains supplementary material available at 10.1007/s11222-026-10875-z.

Statistics and ComputingVol. 36(3)
Queensland University of Technology (AU), University of Warwick (GB), Institut Camille Jordan (FR), Institut National des Sciences Appliquées de Lyon (FR), Université Paris Dauphine-PSL (FR)
University of Warwick, European Commission, Agence Nationale de la Recherche, Ministère des Affaires Etrangères, European Research Council, Core Research for Evolutional Science and Technology
Openalex Percentile: Top 2%
Statistical Methods and Bayesian Inference
29.32
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.