Reducing the biases of the conventional meta-analysis of correlations

Conventional meta-analyses (both fixed and random effects) of correlations are biased due to the mechanical relationship between the estimated correlation and its standard error. Simulations that are closely calibrated to match actual research conditions widely seen across correlational studies in psychology corroborate these biases and suggest two solutions: UWLS<sub>+3</sub> and HS. UWLS<sub>+3</sub> is a simple inverse-variance weighted average (the unrestricted weighted least squares) that adjusts the degrees of freedom and thereby reduces small-sample bias to scientific negligibility. UWLS<sub>+3</sub> as well as the Hunter and Schmidt approach (HS) are less biased than conventional random-effects estimates of correlations and Fisher's <i>z</i>, whether or not there is publication selection bias. However, publication selection bias remains a ubiquitous source of bias and false-positive findings. Despite the relationship between the estimated correlation and its standard error in the absence of selective reporting, the precision-effect test/precision-effect estimate with standard error (PET-PEESE) nearly eradicates publication selection bias. Surprisingly, PET-PEESE keeps the rate of false positives (i.e., type I errors) within their nominal levels under the typical conditions widely seen across psychological research whether there is publication selection bias, or not.

Authors

Institutions

Publication Details

Journal
Research Synthesis Methods
Published
2025-01-01
DOI
https://doi.org/10.1017/rsm.2024.5
Citations
2
Primary Topic
Diverse Approaches in Healthcare and Education Studies
Type
article
Field-Weighted Citation Impact
3.76

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reducing the biases of the conventional meta-analysis of correlations

Hristos Doucouliagos, T. D. Stanley, Tomáš Havránek
2 citations
Research Synthesis Methods
Diverse Approaches in Healthcare and Education Studies
3.76
article

Reducing the biases of the conventional meta-analysis of correlations

Hristos Doucouliagos, T. D. Stanley, Tomáš Havránek
article en
2 citations

Abstract

Conventional meta-analyses (both fixed and random effects) of correlations are biased due to the mechanical relationship between the estimated correlation and its standard error. Simulations that are closely calibrated to match actual research conditions widely seen across correlational studies in psychology corroborate these biases and suggest two solutions: UWLS<sub>+3</sub> and HS. UWLS<sub>+3</sub> is a simple inverse-variance weighted average (the unrestricted weighted least squares) that adjusts the degrees of freedom and thereby reduces small-sample bias to scientific negligibility. UWLS<sub>+3</sub> as well as the Hunter and Schmidt approach (HS) are less biased than conventional random-effects estimates of correlations and Fisher's <i>z</i>, whether or not there is publication selection bias. However, publication selection bias remains a ubiquitous source of bias and false-positive findings. Despite the relationship between the estimated correlation and its standard error in the absence of selective reporting, the precision-effect test/precision-effect estimate with standard error (PET-PEESE) nearly eradicates publication selection bias. Surprisingly, PET-PEESE keeps the rate of false positives (i.e., type I errors) within their nominal levels under the typical conditions widely seen across psychological research whether there is publication selection bias, or not.

Research Synthesis MethodsVol. 16(1)
Deakin University (AU), Charles University (CZ), Centre for Economic Policy Research (GB), Innovative Research (United States) (US)
European Commission, Grantová Agentura České Republiky
Openalex Percentile: Top 8%
Diverse Approaches in Healthcare and Education Studies
3.76
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Reducing the biases of the conventional meta-analysis of correlations — Hristos Doucouliagos, T. D. Stanley, et al. · Research Synthesis Methods (2025) | TGRS Research Map | TGRS