Empirical partially Bayes two sample testing

A common task in high-throughput biology is to test for differences in means between two samples across thousands of features (e.g., genes or proteins), often with only a handful of replicates per sample. Moderated t-tests handle this problem by assuming normality and equal variances, and by applying the empirical partially Bayes principle: a prior is posited and estimated for the nuisance parameters (variances) but not for the primary parameters (means). This approach has been highly successful in genomics, yet the equal variance assumption is often violated in practice. Meanwhile, Welch's unequal variance t-test with few replicates suffers from inflated type-I error and low power. Taking inspiration from moderated t-tests, we extend the empirical partially Bayes paradigm to two-sample testing with unequal variances. We develop two procedures: one that models the ratio of the two sample-specific variances and another that models the two variances jointly, with prior distributions estimated by nonparametric maximum likelihood. Our empirical partially Bayes methods yield p-values that are asymptotically uniform as the number of features grows while the number of replicates remains fixed, ensuring asymptotic type-I error control. Simulations and applications to genomic data demonstrate substantial gains in power.

Publication Details

Journal
ArXiv.org
Published
2025-10-01
Primary Topic
Canadian Policy and Governance
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Empirical partially Bayes two sample testing

ArXiv.org
Canadian Policy and Governance
article

Empirical partially Bayes two sample testing

article en

Abstract

A common task in high-throughput biology is to test for differences in means between two samples across thousands of features (e.g., genes or proteins), often with only a handful of replicates per sample. Moderated t-tests handle this problem by assuming normality and equal variances, and by applying the empirical partially Bayes principle: a prior is posited and estimated for the nuisance parameters (variances) but not for the primary parameters (means). This approach has been highly successful in genomics, yet the equal variance assumption is often violated in practice. Meanwhile, Welch's unequal variance t-test with few replicates suffers from inflated type-I error and low power. Taking inspiration from moderated t-tests, we extend the empirical partially Bayes paradigm to two-sample testing with unequal variances. We develop two procedures: one that models the ratio of the two sample-specific variances and another that models the two variances jointly, with prior distributions estimated by nonparametric maximum likelihood. Our empirical partially Bayes methods yield p-values that are asymptotically uniform as the number of features grows while the number of replicates remains fixed, ensuring asymptotic type-I error control. Simulations and applications to genomic data demonstrate substantial gains in power.

ArXiv.org
Openalex Percentile: Top 38%
Canadian Policy and Governance
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.