Verification Report of Zhao et al. (2023) ‘Effect of Acceptance and Commitment Therapy for depressive disorders: a meta-analysis’

Zhao et al.’s (2023) recent meta-analysis of ACT vs. control interventions for depressive disorders reported an overall meta-analytic effect size of Hedges g = -1.05. However, errors appear to have been made in the extraction of effect sizes. Re-extraction of the effect sizes from the original articles suggests that 3 of 8 recalculated effect sizes were erroneous: Standard Errors (SE) were confused for Standard Deviations (SD) in two cases, and incorrect sample sizes were extracted in one case. When the first meta-analysis they report was re-run following Zhao et al.’s (2023) analytic strategy, the resulting meta-analytic effect size of Hedges’ g = 0.68 was 35% smaller than that reported in the original meta-analysis. The results of other subgroup meta-analyses reported by Zhao et al. (2023) are likely also to be affected. Other aspects of Zhao et al. (2023) may also require scrutiny for the presence of errors. Given the detected errors in the results, the conclusions of Zhao et al. (2023) are undermined and likely require correction. All data and code available at osf.io/jwcmu.