The impact of STEAM-based multiliteracy assessment and problem context on junior high school students' mathematical critical thinking skills

Purposes: This study aims to examine the main effects of assessment model and problem context, as well as their interaction, on junior high school students' mathematical critical thinking skills. The study specifically compares STEAM-based multiliteracy assessment and conventional assessment across contextual and non-contextual mathematical problems. Method: A quantitative approach using a 2 × 2 factorial experimental design was employed. The participants were 64 Grade VIII students from two intact classes at SMPN 2 Peterongan Jombang, Indonesia, with 32 students in each class. Within each class, students were randomly divided into two groups of 16 students, resulting in four experimental groups. Each group received one of four experimental conditions: (1) STEAM-based multiliteracy assessment with contextual problems, (2) STEAM-based multiliteracy assessment with non-contextual problems, (3) conventional assessment with contextual problems, or (4) conventional assessment with non-contextual problems. The intervention was implemented over four sessions during regular classroom activities. Mathematical critical thinking was measured using a validated open-ended instrument covering four dimensions: interpretation, analysis, evaluation, and inference. Pretest and posttest data were collected, and Two-Way Analysis of Variance (ANOVA) was used to examine the main effects of assessment model and problem context and their interaction. Findings: The results showed a statistically significant main effect of the STEAM-based multiliteracy assessment on students' mathematical critical thinking performance, F(1, 60) = 16.994, p < .001, ηp² = .221. In contrast, the main effect of problem context was not statistically significant, F(1, 60) = 3.482, p = .067, ηp² = .055. The interaction between the assessment model and problem context was also not statistically significant, F(1, 60) = 0.085, p = .772, ηp² = .001. Students who received the STEAM-based multiliteracy assessment achieved higher posttest mathematical critical thinking scores than those who received conventional assessment. Significance: The findings provide evidence that STEAM-based multiliteracy assessment is associated with higher mathematical critical thinking performance than conventional assessment, whereas no statistically significant independent effect of problem context or interaction between the two factors was identified. The study extends previous research by examining STEAM as a multiliteracy-oriented assessment design rather than solely as an instructional approach and by experimentally testing the role of problem context within the same factorial framework.

Authors

Institutions

Publication Details

Journal
Al-Jabar Jurnal Pendidikan Matematika
Published
2026-11-18
DOI
https://doi.org/10.24042/ajpm.v17i4.31372
Primary Topic
Mathematics Education and Pedagogy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

The impact of STEAM-based multiliteracy assessment and problem context on junior high school students' mathematical critical thinking skills

Chalimah Chalimah, Ahmad Ivan Farhan, Edy Setiyo Utomo
2 links
Al-Jabar Jurnal Pendidikan Matematika
Mathematics Education and Pedagogy
article

The impact of STEAM-based multiliteracy assessment and problem context on junior high school students' mathematical critical thinking skills

Chalimah Chalimah, Ahmad Ivan Farhan, Edy Setiyo Utomo
article en

Abstract

Purposes: This study aims to examine the main effects of assessment model and problem context, as well as their interaction, on junior high school students' mathematical critical thinking skills. The study specifically compares STEAM-based multiliteracy assessment and conventional assessment across contextual and non-contextual mathematical problems. Method: A quantitative approach using a 2 × 2 factorial experimental design was employed. The participants were 64 Grade VIII students from two intact classes at SMPN 2 Peterongan Jombang, Indonesia, with 32 students in each class. Within each class, students were randomly divided into two groups of 16 students, resulting in four experimental groups. Each group received one of four experimental conditions: (1) STEAM-based multiliteracy assessment with contextual problems, (2) STEAM-based multiliteracy assessment with non-contextual problems, (3) conventional assessment with contextual problems, or (4) conventional assessment with non-contextual problems. The intervention was implemented over four sessions during regular classroom activities. Mathematical critical thinking was measured using a validated open-ended instrument covering four dimensions: interpretation, analysis, evaluation, and inference. Pretest and posttest data were collected, and Two-Way Analysis of Variance (ANOVA) was used to examine the main effects of assessment model and problem context and their interaction. Findings: The results showed a statistically significant main effect of the STEAM-based multiliteracy assessment on students' mathematical critical thinking performance, F(1, 60) = 16.994, p < .001, ηp² = .221. In contrast, the main effect of problem context was not statistically significant, F(1, 60) = 3.482, p = .067, ηp² = .055. The interaction between the assessment model and problem context was also not statistically significant, F(1, 60) = 0.085, p = .772, ηp² = .001. Students who received the STEAM-based multiliteracy assessment achieved higher posttest mathematical critical thinking scores than those who received conventional assessment. Significance: The findings provide evidence that STEAM-based multiliteracy assessment is associated with higher mathematical critical thinking performance than conventional assessment, whereas no statistically significant independent effect of problem context or interaction between the two factors was identified. The study extends previous research by examining STEAM as a multiliteracy-oriented assessment design rather than solely as an instructional approach and by experimentally testing the role of problem context within the same factorial framework.

Al-Jabar Jurnal Pendidikan MatematikaVol. 17(4)
Universitas Pesantren Tinggi Darul Ulum Jombang (ID), Universitas PGRI Jombang (ID)
Quality education
Mathematics Education and Pedagogy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon