<i>SampleSavvy:</i> Evaluating a Web Tool for Easier Sample Size Planning
Determining an appropriate sample size is a challenging part of study design. Although established tools such as G*Power are widely used, they can be difficult for users without strong statistical backgrounds. To address this challenge, we developed SampleSavvy, a web-based tool that guides users through key power-analysis parameters and shows how these decisions influence sample size estimates. This tool provides an interactive, step-by-step interface for specifying effect size, alpha, and power while allowing real-time exploration. We evaluated its usability through a think-aloud study with seven participants who had varying experience levels. Results show that participants perceived SampleSavvy as more intuitive and easier to use than G*Power, particularly because of its structured workflow and clear guidance. Participants also identified future improvements, including expanded statistical test options and more flexible input methods. These findings suggest opportunities for user-centered tools that support sample size planning and research design.
Authors
- Hansen Lee
- Emily Sidnam-Mauch (ORCID: https://orcid.org/0000-0003-3372-7778)
- Susan McGregor
- Bart Knijnenburg
- Kelly Caine
Institutions
- Columbia University (US)
- Clemson University (US)
Publication Details
- Journal
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Published
- 2026-08-03
- DOI
- https://doi.org/10.1177/10711813261475180
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Office of Advanced Cyberinfrastructure