On the External Validity of Single-Case Designs: A Bayesian Approach

When selecting interventions for students or clients, practitioners typically need to estimate the probability that it will lead to socially significant changes in behavior. One potential solution to address this issue involves computing the conditional probability of success given the results observed in the research literature. The purpose of the study was to use Bayesian inference, an approach that considers prior probability, to examine how the number of successful experiments may be used to assess the external validity (i.e., generality across participants) of findings from single-case research. Although the analyses show that relying on more experiments tends to produce better estimates, having as few as five successful experiments may result in a success rate with a lower bound of at least .50. Given that research on the topic remains limited, we argue that our proposal should not be viewed as immutable, but rather as a starting point for spurring further discussion and research on the topic.

Authors

Publication Details

Published
2025-08-15
DOI
https://doi.org/10.31234/osf.io/f23x9_v1
Primary Topic
Optimal Experimental Design Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On the External Validity of Single-Case Designs: A Bayesian Approach

Marc J. Lanovaz
Optimal Experimental Design Methods
article

On the External Validity of Single-Case Designs: A Bayesian Approach

Marc J. Lanovaz
article en

Abstract

When selecting interventions for students or clients, practitioners typically need to estimate the probability that it will lead to socially significant changes in behavior. One potential solution to address this issue involves computing the conditional probability of success given the results observed in the research literature. The purpose of the study was to use Bayesian inference, an approach that considers prior probability, to examine how the number of successful experiments may be used to assess the external validity (i.e., generality across participants) of findings from single-case research. Although the analyses show that relying on more experiments tends to produce better estimates, having as few as five successful experiments may result in a success rate with a lower bound of at least .50. Given that research on the topic remains limited, we argue that our proposal should not be viewed as immutable, but rather as a starting point for spurring further discussion and research on the topic.

Openalex Percentile: Top 74%
Optimal Experimental Design Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.