On the implementation of maximum entropy sampling with unequal probabilities and without replacement

Sampling with maximum entropy offers robustness to statistical inference based on randomization theory. However, there were no comprehensive, practical guides explaining how to implement maximum entropy sampling for finite populations with unequal probabilities and without replacement. This article serves as both a toolkit and a reference guide for researchers and engineers, filling a gap in the literature. It links key formal results with ready-to-use algorithms that can be implemented in any procedural programming language. Maximum entropy sampling is straightforward when the sample size is allowed to vary. This is achieved via the <i>Poisson sampling</i> design, in which the sample size is a random variable distributed according to a Poisson binomial distribution. In contrast, the <i>conditional Poisson sampling</i> design, which is obtained by conditioning Poisson sampling on a fixed sample size, has long posed a significant challenge to statisticians.•A compendium of formal results for Poisson sampling, the Poisson binomial distribution, and conditional Poisson sampling is presented.•The computation of inclusion probabilities up to the second order is detailed for the conditional Poisson sampling, and the corresponding algorithms are provided.•Ready-to-use algorithms are provided for implementing Poisson sampling and the Poisson binomial distribution. For conditional Poisson sampling, the rejective, draw-by-draw, sequential, and exchange sampling algorithms are detailed.

Authors

Institutions

Publication Details

Journal
MethodsX
Published
2025-12-30
DOI
https://doi.org/10.1016/j.mex.2025.103780
Primary Topic
Statistical Mechanics and Entropy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On the implementation of maximum entropy sampling with unequal probabilities and without replacement

Philippe Aubry
MethodsX
Statistical Mechanics and Entropy
article

On the implementation of maximum entropy sampling with unequal probabilities and without replacement

Philippe Aubry
article en

Abstract

Sampling with maximum entropy offers robustness to statistical inference based on randomization theory. However, there were no comprehensive, practical guides explaining how to implement maximum entropy sampling for finite populations with unequal probabilities and without replacement. This article serves as both a toolkit and a reference guide for researchers and engineers, filling a gap in the literature. It links key formal results with ready-to-use algorithms that can be implemented in any procedural programming language. Maximum entropy sampling is straightforward when the sample size is allowed to vary. This is achieved via the <i>Poisson sampling</i> design, in which the sample size is a random variable distributed according to a Poisson binomial distribution. In contrast, the <i>conditional Poisson sampling</i> design, which is obtained by conditioning Poisson sampling on a fixed sample size, has long posed a significant challenge to statisticians.•A compendium of formal results for Poisson sampling, the Poisson binomial distribution, and conditional Poisson sampling is presented.•The computation of inclusion probabilities up to the second order is detailed for the conditional Poisson sampling, and the corresponding algorithms are provided.•Ready-to-use algorithms are provided for implementing Poisson sampling and the Poisson binomial distribution. For conditional Poisson sampling, the rejective, draw-by-draw, sequential, and exchange sampling algorithms are detailed.

MethodsXVol. 16
Fondation Pour la Recherche Sur la Biodiversité (FR), Office Français de la Biodiversité
Reduced inequalities
Openalex Percentile: Top 30%
Statistical Mechanics and Entropy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.