A Primer on the Use of Frequentist Confidence Analysis in Neurology Clinical Trials

Clinical researchers are drawn toward Bayesian methods that facilitate probability statements quantifying confidence in particular treatment effects of interest. Although traditional frequentist statistics are not typically used to make such statements, frequentist confidence analysis is an alternative to Bayesian methods, which fully supports confidence statements about observed treatment effects. Despite frequentist confidence analysis dating back to the 1950s and being sometimes used in clinical studies, clinical researchers may not be aware of how to use frequentist confidence to design and analyze clinical trials. Therefore, this Research Methods in Neurology primer describes the application of frequentist confidence to address the practical topic of design and analysis of clinical trials. The primer expands on well-understood ideas around frequentist CIs to describe the notion of confidence distributions, which can be used to flexibly quantify the strength of evidence about any treatment effect of interest. Then, we describe how to use frequentist confidence in a specific treatment effect (e.g., benefit or lack of meaningful benefit) to monitor data in an adaptive trial setting. We illustrate how frequentist confidence-adaptive trials can achieve tight control of Type I error rate. Finally, we provide 2 R software packages ("confidenceCurves" and "confidenceSim"), with a clinician-friendly user interface ("confidenceCurvesApp"), to support frequentist confidence-based reasoning and confidence-based trial design for neurology research.

Authors

Institutions

Publication Details

Journal
Neurology
Published
2026-11-12
DOI
https://doi.org/10.1212/wnl.0000000000218767
Primary Topic
Statistical Methods in Clinical Trials
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Primer on the Use of Frequentist Confidence Analysis in Neurology Clinical Trials

Ian C. Marschner, Chloe A. Mutimer, Leonid P. Churilov, Henry H. Zhao et al.
Neurology
Statistical Methods in Clinical Trials
article

A Primer on the Use of Frequentist Confidence Analysis in Neurology Clinical Trials

Ian C. Marschner, Chloe A. Mutimer, Leonid P. Churilov, Henry H. Zhao, Hannah Tabitha Johns, Freda Werdiger, Bruce C.V. Campbell, Tolulope T. Sajobi, Mark William Parsons, Kathryn S. Hayward, Nathalie H. Launder, Michael D. Hill
article en

Abstract

Clinical researchers are drawn toward Bayesian methods that facilitate probability statements quantifying confidence in particular treatment effects of interest. Although traditional frequentist statistics are not typically used to make such statements, frequentist confidence analysis is an alternative to Bayesian methods, which fully supports confidence statements about observed treatment effects. Despite frequentist confidence analysis dating back to the 1950s and being sometimes used in clinical studies, clinical researchers may not be aware of how to use frequentist confidence to design and analyze clinical trials. Therefore, this Research Methods in Neurology primer describes the application of frequentist confidence to address the practical topic of design and analysis of clinical trials. The primer expands on well-understood ideas around frequentist CIs to describe the notion of confidence distributions, which can be used to flexibly quantify the strength of evidence about any treatment effect of interest. Then, we describe how to use frequentist confidence in a specific treatment effect (e.g., benefit or lack of meaningful benefit) to monitor data in an adaptive trial setting. We illustrate how frequentist confidence-adaptive trials can achieve tight control of Type I error rate. Finally, we provide 2 R software packages ("confidenceCurves" and "confidenceSim"), with a clinician-friendly user interface ("confidenceCurvesApp"), to support frequentist confidence-based reasoning and confidence-based trial design for neurology research.

NeurologyVol. 107(11)
The University of Sydney (AU), The Royal Melbourne Hospital (AU), The University of Melbourne (AU), University of Calgary (CA), Liverpool Hospital (AU), UNSW Sydney (AU), Ingham Institute (AU), National Health and Medical Research Council (AU), Hotchkiss Brain Institute (CA)
Good health and well-being
Statistical Methods in Clinical Trials
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon