<i>projectgst</i> : A Shiny Application for Generalizability Study Analysis in Nonformal Education Settings
Generalizability Theory (G-Theory) extends classical reliability estimation by simultaneously de-composing score variance into multiple sources of measurement error such as raters, occasions, and items within a single analytical framework. Despite its methodological advantages, G-Theory analyses typically require specialized programming expertise, limiting accessibility for applied researchers. This paper introduces projectGST , an open-source R Shiny application that provides a unified, code-free interface for conducting G-Theory analyses. The application integrates preliminary statistical analyses including descriptive statistics, normality tests, inter-rater correlation matrices, Cronbach’s alpha, and intraclass correlation coefficients with G-Study variance component estimation and D-Study reliability optimization. projectgst supports both crossed and nested measurement designs and is illustrated using simulated datasets representative of nonformal education assessment contexts, including tutor evaluations at community learning centers and portfolio-based assessments in equivalency education programs. The application is openly accessible via a hosted Shiny interface and GitHub repository.
Authors
- Indriani H. Ismail (ORCID: https://orcid.org/0009-0006-8454-4700)
- Dyah Metianing
- Muhammad Nursa’ban (ORCID: https://orcid.org/0000-0003-3870-9085)
- Febrian Solikhin (ORCID: https://orcid.org/0000-0001-8088-347X)
- Soni Nopembri (ORCID: https://orcid.org/0000-0002-9094-6451)
- Amran Hapsan (ORCID: https://orcid.org/0000-0002-1857-9976)
- Ahmad Ahmad (ORCID: https://orcid.org/0000-0002-5797-3693)
- Eko Wahyudi
- Habib Ratu Perwira Negara
Institutions
- Yogyakarta State University (ID)
- University of Islamic Studies (PK)
Publication Details
- Journal
- Applied Psychological Measurement
- Published
- 2026-07-23
- DOI
- https://doi.org/10.1177/01466216261471172
- Primary Topic
- Psychometric Methodologies and Testing
- Type
- article
- Field-Weighted Citation Impact
- 0.00