Diagnosing upper-secondary students’ critical thinking in organic chemistry: A three-tier multiple-choice test on hydrocarbons

This research examines upper-secondary students’ critical thinking regarding hydrocarbons through a three-tier multiple-choice test (TT-MCT) that corresponds with six indicators: interpretation, analysis, evaluation, inference, explanation, and self-regulation. The instrument consisted of 20 five-option items with keyed reasons and a confidence tier. An expert review confirmed content validity (VR = 3.83), and internal consistency during the main administration was high (Cronbach’s α = 0.911). There were 85 Grade XI students from a public school who had finished the necessary prerequisite topics. Descriptive analyses revealed an overall mean of 59.55%, categorized as sufficient. Students did better on explanation (63.84%) and interpretation (63.12%) but worse on inference (53.88%) and analysis (54.35%). These findings indicate that learners more easily process descriptive and explanatory cues than those that require relational reasoning and the formulation of evidence-based conclusions. The three-tier format further revealed mixed answer–reason patterns (e.g., correct answers paired with flawed reasoning), indicating that many students can retrieve declarative knowledge but struggle to justify conclusions, particularly in mechanism-rich topics such as free-radical substitution. The findings endorse pedagogical designs that enhance the visibility and calibration of reasoning, including argumentation/claim– evidence–reasoning tasks focused on core mechanisms, targeted self-explanation prompts in worked examples, explicit coordination of multiple representations, and the formative application of confidence data to mitigate overconfidence and address misconceptions. The TT-MCT was helpful for assessing how well people were doing and for identifying actionable goals to improve analysis and inference in organic chemistry.

Authors

Publication Details

Journal
Springer Link (Chiba Institute of Technology)
Published
2026-02-24
DOI
https://doi.org/10.1051/e3sconf/202669505004/pdf
Primary Topic
Science Education and Pedagogy
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diagnosing upper-secondary students’ critical thinking in organic chemistry: A three-tier multiple-choice test on hydrocarbons

Nur Candra Eka Setiawan, Munzil Munzil, Hanifah Ariani Mahmudah, Muntholib Muntholib et al.
Springer Link (Chiba Institute of Technology)
Science Education and Pedagogy
article

Diagnosing upper-secondary students’ critical thinking in organic chemistry: A three-tier multiple-choice test on hydrocarbons

Nur Candra Eka Setiawan, Munzil Munzil, Hanifah Ariani Mahmudah, Muntholib Muntholib, M. Muchson
article en

Abstract

This research examines upper-secondary students’ critical thinking regarding hydrocarbons through a three-tier multiple-choice test (TT-MCT) that corresponds with six indicators: interpretation, analysis, evaluation, inference, explanation, and self-regulation. The instrument consisted of 20 five-option items with keyed reasons and a confidence tier. An expert review confirmed content validity (VR = 3.83), and internal consistency during the main administration was high (Cronbach’s α = 0.911). There were 85 Grade XI students from a public school who had finished the necessary prerequisite topics. Descriptive analyses revealed an overall mean of 59.55%, categorized as sufficient. Students did better on explanation (63.84%) and interpretation (63.12%) but worse on inference (53.88%) and analysis (54.35%). These findings indicate that learners more easily process descriptive and explanatory cues than those that require relational reasoning and the formulation of evidence-based conclusions. The three-tier format further revealed mixed answer–reason patterns (e.g., correct answers paired with flawed reasoning), indicating that many students can retrieve declarative knowledge but struggle to justify conclusions, particularly in mechanism-rich topics such as free-radical substitution. The findings endorse pedagogical designs that enhance the visibility and calibration of reasoning, including argumentation/claim– evidence–reasoning tasks focused on core mechanisms, targeted self-explanation prompts in worked examples, explicit coordination of multiple representations, and the formative application of confidence data to mitigate overconfidence and address misconceptions. The TT-MCT was helpful for assessing how well people were doing and for identifying actionable goals to improve analysis and inference in organic chemistry.

Springer Link (Chiba Institute of Technology)
Direktorat Jenderal Pendidikan Tinggi, Direktorat Riset dan Pengabdian Masyarakat, Direcció General de Recerca, Generalitat de Catalunya
Quality Education
Openalex Percentile: Top 44%
Science Education and Pedagogy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.