A preliminary evaluation of CodeChum as a formative assessment platform

This study evaluated CodeChum as a formative assessment platform used in programming courses in the School of Computing. Specifically, it examined students’ perceptions of CodeChum in terms of system usability, user experience, learning experiences, and user satisfaction. A descriptive research design was employed involving 52 second-year Bachelor of Science in Computer Science students who had used CodeChum since its implementation during Academic Year 2025–2026. Data were collected through the System Usability Scale (SUS), a researcher-developed questionnaire, and open-ended questions. Descriptive statistics and Cronbach’s alpha were used to analyze the quantitative data, while thematic analysis was employed for the qualitative responses. The findings showed that CodeChum obtained a SUS score of 49.7, indicating poor usability. User experience, learning support, engagement and motivation, skill development, and user satisfaction were all interpreted as neutral. Reliability analysis showed acceptable to excellent internal consistency across all constructs. Qualitative responses revealed that students appreciated the platform’s accessibility, hands-on programming activities, automated feedback, and gamified features. However, several respondents reported concerns related to strict output checking, case sensitivity, grading inconsistencies, and problematic test cases. The study concludes that CodeChum provides useful support for programming instruction but requires improvements in usability, feedback mechanisms, and assessment features to enhance students’ overall experiences with the platform.

Authors

Institutions

Publication Details

Journal
International Journal of Research Studies in Education
Published
2026-11-20
DOI
https://doi.org/10.5861/ijrse.2026.26425
Primary Topic
Teaching and Learning Programming
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A preliminary evaluation of CodeChum as a formative assessment platform

Mary Jane Rabena, Arcely P. Napalit
1 links
International Journal of Research Studies in Education
Teaching and Learning Programming
article

A preliminary evaluation of CodeChum as a formative assessment platform

Mary Jane Rabena, Arcely P. Napalit
article en

Abstract

This study evaluated CodeChum as a formative assessment platform used in programming courses in the School of Computing. Specifically, it examined students’ perceptions of CodeChum in terms of system usability, user experience, learning experiences, and user satisfaction. A descriptive research design was employed involving 52 second-year Bachelor of Science in Computer Science students who had used CodeChum since its implementation during Academic Year 2025–2026. Data were collected through the System Usability Scale (SUS), a researcher-developed questionnaire, and open-ended questions. Descriptive statistics and Cronbach’s alpha were used to analyze the quantitative data, while thematic analysis was employed for the qualitative responses. The findings showed that CodeChum obtained a SUS score of 49.7, indicating poor usability. User experience, learning support, engagement and motivation, skill development, and user satisfaction were all interpreted as neutral. Reliability analysis showed acceptable to excellent internal consistency across all constructs. Qualitative responses revealed that students appreciated the platform’s accessibility, hands-on programming activities, automated feedback, and gamified features. However, several respondents reported concerns related to strict output checking, case sensitivity, grading inconsistencies, and problematic test cases. The study concludes that CodeChum provides useful support for programming instruction but requires improvements in usability, feedback mechanisms, and assessment features to enhance students’ overall experiences with the platform.

International Journal of Research Studies in EducationVol. 15(23)
Holy Angel University (PH)
Quality education
Teaching and Learning Programming
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon