Developing and Validating a Rubric for Assessing 21st-Century Skills Creativity, Collaboration and Critical Thinking) in Project-Based Learning: A Many-Facet Rasch Measurement Approach in Imo State, South-East Nigeria
Project-based learning (PBL) is promoted as a way of developing 21st-century skills, yet teachers need valid and fair tools to assess skills such as creativity, collaboration and critical thinking. This study developed a nine-criterion, four-level analytic rubric and validated it with a many-facet Rasch measurement (MFRM) approach in Imo State, South-East Nigeria. Content validity was established through review by eight experts, and the rubric was piloted before the main study. In the main study, six trained teachers rated 120 Senior Secondary 2 students' PBL work in a linked design, producing 3,240 ratings. The rating-scale many-facet model showed that the rubric defined a coherent variable: all criteria and raters fell within acceptable fit limits (infit and outfit mean squares 0.88 to 1.29), and the first residual contrast (eigenvalue = 1.58) gave no sign of a second dimension. The rubric separated students reliably (separation = 3.71; reliability = .93; five strata). Raters differed significantly in severity, spanning about one logit (−0.49 to 0.52), and raw scores shifted the rankings of 22 students (18.3%) by ten or more places relative to rater-adjusted measures. Only three of 54 rater-by-criterion interactions were flagged, close to chance. Rasch measures correlated with teachers' project grades (r = .78). The findings support the rubric as a valid and reliable school-based tool and show why rater effects should be modelled rather than ignored. Keywords: Rubric Validation; Many-Facet Rasch Measurement; 21st-Century Skills; Project-Based Learning; Rater Effects; Nigeria
Authors
- PhD Celestine Kelvins Ihekwoaba
- PhD* Nathaniel TimAhanna Ukwuoma (ORCID: https://orcid.org/0009-0009-4940-4974)
- Joy Onyeka Nkeiruka (ORCID: https://orcid.org/0009-0006-3380-3151)
Institutions
- Alvan Ikoku Federal University of Education, Owerri (NG)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-21
- DOI
- https://doi.org/10.5281/zenodo.24419661
- Primary Topic
- Problem and Project Based Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00