<i>SampleSavvy:</i> Evaluating a Web Tool for Easier Sample Size Planning

Determining an appropriate sample size is a challenging part of study design. Although established tools such as G*Power are widely used, they can be difficult for users without strong statistical backgrounds. To address this challenge, we developed SampleSavvy, a web-based tool that guides users through key power-analysis parameters and shows how these decisions influence sample size estimates. This tool provides an interactive, step-by-step interface for specifying effect size, alpha, and power while allowing real-time exploration. We evaluated its usability through a think-aloud study with seven participants who had varying experience levels. Results show that participants perceived SampleSavvy as more intuitive and easier to use than G*Power, particularly because of its structured workflow and clear guidance. Participants also identified future improvements, including expanded statistical test options and more flexible input methods. These findings suggest opportunities for user-centered tools that support sample size planning and research design.

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2026-08-03
DOI
https://doi.org/10.1177/10711813261475180
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SampleSavvy: Evaluating a Web Tool for Easier Sample Size Planning

Hansen Lee, Emily Sidnam-Mauch, Susan McGregor, Bart Knijnenburg et al.
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Meta-analysis and systematic reviews
article

SampleSavvy: Evaluating a Web Tool for Easier Sample Size Planning

Hansen Lee, Emily Sidnam-Mauch, Susan McGregor, Bart Knijnenburg, Kelly Caine
article en

Abstract

Determining an appropriate sample size is a challenging part of study design. Although established tools such as G*Power are widely used, they can be difficult for users without strong statistical backgrounds. To address this challenge, we developed SampleSavvy, a web-based tool that guides users through key power-analysis parameters and shows how these decisions influence sample size estimates. This tool provides an interactive, step-by-step interface for specifying effect size, alpha, and power while allowing real-time exploration. We evaluated its usability through a think-aloud study with seven participants who had varying experience levels. Results show that participants perceived SampleSavvy as more intuitive and easier to use than G*Power, particularly because of its structured workflow and clear guidance. Participants also identified future improvements, including expanded statistical test options and more flexible input methods. These findings suggest opportunities for user-centered tools that support sample size planning and research design.

Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Columbia University (US), Clemson University (US)
Office of Advanced Cyberinfrastructure
Openalex Percentile: Top 8%
Meta-analysis and systematic reviews
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.