Developing and Validating a Rubric for Assessing 21st-Century Skills Creativity, Collaboration and Critical Thinking) in Project-Based Learning: A Many-Facet Rasch Measurement Approach in Imo State, South-East Nigeria

Project-based learning (PBL) is promoted as a way of developing 21st-century skills, yet teachers need valid and fair tools to assess skills such as creativity, collaboration and critical thinking. This study developed a nine-criterion, four-level analytic rubric and validated it with a many-facet Rasch measurement (MFRM) approach in Imo State, South-East Nigeria. Content validity was established through review by eight experts, and the rubric was piloted before the main study. In the main study, six trained teachers rated 120 Senior Secondary 2 students' PBL work in a linked design, producing 3,240 ratings. The rating-scale many-facet model showed that the rubric defined a coherent variable: all criteria and raters fell within acceptable fit limits (infit and outfit mean squares 0.88 to 1.29), and the first residual contrast (eigenvalue = 1.58) gave no sign of a second dimension. The rubric separated students reliably (separation = 3.71; reliability = .93; five strata). Raters differed significantly in severity, spanning about one logit (−0.49 to 0.52), and raw scores shifted the rankings of 22 students (18.3%) by ten or more places relative to rater-adjusted measures. Only three of 54 rater-by-criterion interactions were flagged, close to chance. Rasch measures correlated with teachers' project grades (r = .78). The findings support the rubric as a valid and reliable school-based tool and show why rater effects should be modelled rather than ignored. Keywords: Rubric Validation; Many-Facet Rasch Measurement; 21st-Century Skills; Project-Based Learning; Rater Effects; Nigeria

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-21
DOI
https://doi.org/10.5281/zenodo.24419661
Primary Topic
Problem and Project Based Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Developing and Validating a Rubric for Assessing 21st-Century Skills Creativity, Collaboration and Critical Thinking) in Project-Based Learning: A Many-Facet Rasch Measurement Approach in Imo State, South-East Nigeria

PhD Celestine Kelvins Ihekwoaba, PhD* Nathaniel TimAhanna Ukwuoma, Joy Onyeka Nkeiruka
Zenodo (CERN European Organization for Nuclear Research)
Problem and Project Based Learning
article

Developing and Validating a Rubric for Assessing 21st-Century Skills Creativity, Collaboration and Critical Thinking) in Project-Based Learning: A Many-Facet Rasch Measurement Approach in Imo State, South-East Nigeria

PhD Celestine Kelvins Ihekwoaba, PhD* Nathaniel TimAhanna Ukwuoma, Joy Onyeka Nkeiruka
article en

Abstract

Project-based learning (PBL) is promoted as a way of developing 21st-century skills, yet teachers need valid and fair tools to assess skills such as creativity, collaboration and critical thinking. This study developed a nine-criterion, four-level analytic rubric and validated it with a many-facet Rasch measurement (MFRM) approach in Imo State, South-East Nigeria. Content validity was established through review by eight experts, and the rubric was piloted before the main study. In the main study, six trained teachers rated 120 Senior Secondary 2 students' PBL work in a linked design, producing 3,240 ratings. The rating-scale many-facet model showed that the rubric defined a coherent variable: all criteria and raters fell within acceptable fit limits (infit and outfit mean squares 0.88 to 1.29), and the first residual contrast (eigenvalue = 1.58) gave no sign of a second dimension. The rubric separated students reliably (separation = 3.71; reliability = .93; five strata). Raters differed significantly in severity, spanning about one logit (−0.49 to 0.52), and raw scores shifted the rankings of 22 students (18.3%) by ten or more places relative to rater-adjusted measures. Only three of 54 rater-by-criterion interactions were flagged, close to chance. Rasch measures correlated with teachers' project grades (r = .78). The findings support the rubric as a valid and reliable school-based tool and show why rater effects should be modelled rather than ignored. Keywords: Rubric Validation; Many-Facet Rasch Measurement; 21st-Century Skills; Project-Based Learning; Rater Effects; Nigeria

Zenodo (CERN European Organization for Nuclear Research)
Alvan Ikoku Federal University of Education, Owerri (NG)
Problem and Project Based Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Developing and Validating a Rubric for Assessing 21st-Century Skills Creativity, Collaboration and Critical Thinking) in Project-Based Learning: A Many-Facet Rasch Measurement Approach in Imo State, South-East Nigeria — PhD Celestine Kelvins Ihekwoaba, PhD* Nathaniel TimAhanna Ukwuoma, et al. · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS