<i>projectgst</i> : A Shiny Application for Generalizability Study Analysis in Nonformal Education Settings

Generalizability Theory (G-Theory) extends classical reliability estimation by simultaneously de-composing score variance into multiple sources of measurement error such as raters, occasions, and items within a single analytical framework. Despite its methodological advantages, G-Theory analyses typically require specialized programming expertise, limiting accessibility for applied researchers. This paper introduces projectGST , an open-source R Shiny application that provides a unified, code-free interface for conducting G-Theory analyses. The application integrates preliminary statistical analyses including descriptive statistics, normality tests, inter-rater correlation matrices, Cronbach’s alpha, and intraclass correlation coefficients with G-Study variance component estimation and D-Study reliability optimization. projectgst supports both crossed and nested measurement designs and is illustrated using simulated datasets representative of nonformal education assessment contexts, including tutor evaluations at community learning centers and portfolio-based assessments in equivalency education programs. The application is openly accessible via a hosted Shiny interface and GitHub repository.

Authors

Institutions

Publication Details

Journal
Applied Psychological Measurement
Published
2026-07-23
DOI
https://doi.org/10.1177/01466216261471172
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

projectgst : A Shiny Application for Generalizability Study Analysis in Nonformal Education Settings

Indriani H. Ismail, Dyah Metianing, Muhammad Nursa’ban, Febrian Solikhin et al.
Applied Psychological Measurement
Psychometric Methodologies and Testing
article

projectgst : A Shiny Application for Generalizability Study Analysis in Nonformal Education Settings

Indriani H. Ismail, Dyah Metianing, Muhammad Nursa’ban, Febrian Solikhin, Soni Nopembri, Amran Hapsan, Ahmad Ahmad, Eko Wahyudi, Habib Ratu Perwira Negara
article en

Abstract

Generalizability Theory (G-Theory) extends classical reliability estimation by simultaneously de-composing score variance into multiple sources of measurement error such as raters, occasions, and items within a single analytical framework. Despite its methodological advantages, G-Theory analyses typically require specialized programming expertise, limiting accessibility for applied researchers. This paper introduces projectGST , an open-source R Shiny application that provides a unified, code-free interface for conducting G-Theory analyses. The application integrates preliminary statistical analyses including descriptive statistics, normality tests, inter-rater correlation matrices, Cronbach’s alpha, and intraclass correlation coefficients with G-Study variance component estimation and D-Study reliability optimization. projectgst supports both crossed and nested measurement designs and is illustrated using simulated datasets representative of nonformal education assessment contexts, including tutor evaluations at community learning centers and portfolio-based assessments in equivalency education programs. The application is openly accessible via a hosted Shiny interface and GitHub repository.

Applied Psychological Measurement
Yogyakarta State University (ID), University of Islamic Studies (PK)
Quality Education
Openalex Percentile: Top 4%
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

<i>projectgst</i> : A Shiny Application for Generalizability Study Analysis in Nonformal Education Settings — Indriani H. Ismail, Dyah Metianing, et al. · Applied Psychological Measurement (2026) | TGRS Research Map | TGRS