The untapped potential of Bayesian region of practical equivalence for assessing null effects in multi-domain research

• Null effects are inherent in multi-modal research • Knowledge of null effects is scientifically and practically meaningful • Null hypothesis significance testing is inadequate for dealing with null effects • Bayesian region of practical equivalence as alternative approach • Promoting cumulative multi-modal research Multi-domain research has become a popular topic in building science. However, studies in this area have not yet paid sufficient attention to the inadequacy of the dominant research practices entrenched in the conventional null hypothesis significance testing (NHST) when dealing with null effects. To address this problem, we first explain why null effects inherently exist in multi-domain research and argue for the importance of null effects. We then highlight numerous limitations of NHST that are particularly relevant to multi-domain research, for example the inability to accept null hypothesis or to refute false theories, the untested and thereby unfalsifiable alternative hypotheses, the underpowered results that mislead cumulative research and aggravate publication bias, the often ignored testing intentions, the fallacious black-and-white thinking, unintuitive interpretation and common misunderstanding, and the asymptotic behavior. Inspired by advances in methodology literature, we introduce Bayesian region of practical equivalence (ROPE) as an alternative approach that allows researchers to decide for, against, or remain undecided regarding whether an effect of research target is practically equivalent to a value of interest (e.g., the null value). The Bayesian ROPE approach has several advantages over NHST, namely the ability to establish practical absence of an effect and to refute false theories, better scalability, no requirement on minimum sample size, intuitive interpretations, and independence from testing intentions. We contend that this alternative approach can promote cumulative multi-domain research and mitigate publication bias.

Authors

Institutions

Publication Details

Journal
Building and Environment
Published
2025-07-05
DOI
https://doi.org/10.1016/j.buildenv.2025.113390
Citations
2
Primary Topic
Statistical Methods and Bayesian Inference
Type
article
Field-Weighted Citation Impact
5.26
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The untapped potential of Bayesian region of practical equivalence for assessing null effects in multi-domain research

Jian Pan, Rania Christoforou, Marcel Schweiker, Lucy Nives Wiedermann
2 citations
Building and Environment
Statistical Methods and Bayesian Inference
5.26
article

The untapped potential of Bayesian region of practical equivalence for assessing null effects in multi-domain research

Jian Pan, Rania Christoforou, Marcel Schweiker, Lucy Nives Wiedermann
article en
2 citations

Abstract

• Null effects are inherent in multi-modal research • Knowledge of null effects is scientifically and practically meaningful • Null hypothesis significance testing is inadequate for dealing with null effects • Bayesian region of practical equivalence as alternative approach • Promoting cumulative multi-modal research Multi-domain research has become a popular topic in building science. However, studies in this area have not yet paid sufficient attention to the inadequacy of the dominant research practices entrenched in the conventional null hypothesis significance testing (NHST) when dealing with null effects. To address this problem, we first explain why null effects inherently exist in multi-domain research and argue for the importance of null effects. We then highlight numerous limitations of NHST that are particularly relevant to multi-domain research, for example the inability to accept null hypothesis or to refute false theories, the untested and thereby unfalsifiable alternative hypotheses, the underpowered results that mislead cumulative research and aggravate publication bias, the often ignored testing intentions, the fallacious black-and-white thinking, unintuitive interpretation and common misunderstanding, and the asymptotic behavior. Inspired by advances in methodology literature, we introduce Bayesian region of practical equivalence (ROPE) as an alternative approach that allows researchers to decide for, against, or remain undecided regarding whether an effect of research target is practically equivalent to a value of interest (e.g., the null value). The Bayesian ROPE approach has several advantages over NHST, namely the ability to establish practical absence of an effect and to refute false theories, better scalability, no requirement on minimum sample size, intuitive interpretations, and independence from testing intentions. We contend that this alternative approach can promote cumulative multi-domain research and mitigate publication bias.

Building and EnvironmentVol. 283
RWTH Aachen University (DE)
Openalex Percentile: Top 5%
Statistical Methods and Bayesian Inference
5.26
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.