Beyond Point Allocation: Auditing Course-Objective Alignment and Item-Level Performance across a Two-Semester Organic Chemistry Sequence

Course-assessment alignment is often judged from a blueprint that shows how many examination points are assigned to each course objective. Such a summary can be reassuring, yet it leaves unanswered what students are actually required to do. This study examined two consecutive final examinations in a 64 h undergraduate organic chemistry course for energy storage engineering majors at a Chinese university. The evidence base combined the official syllabus, examination blueprint, scoring guides, 119 scored subtasks, and regular final-examination records from 84 students in Semester 1 and 83 students in Semester 2. Scored subtasks were coded for course objective, revised-Bloom cognitive demand, organic chemistry task, intended difficulty, and contextual demand; student performance was analyzed at the 38 and 40 parent units for which scores were recorded. Point allocation closely matched the intended 40:60 distribution for Course Objectives 1 and 2 (44:56 and 38:62). In contrast, 99 of 100 points in Semester 1 and all 100 points in Semester 2 could be completed without using production, everyday-life, or engineering context. Item-level results further showed that observed difficulty did not increase monotonically across Bloom categories; several of the lowest score rates occurred on synthesis and selected multistep transformations. The findings show how a layered audit of alignment and student performance can reveal features that point allocation alone does not capture.

Authors

Institutions

Publication Details

Journal
Journal of Chemical Education
Published
2026-11-18
DOI
https://doi.org/10.1021/acs.jchemed.6c01312
Primary Topic
Educational Assessment and Pedagogy
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Beyond Point Allocation: Auditing Course-Objective Alignment and Item-Level Performance across a Two-Semester Organic Chemistry Sequence

Yuhui Zhao, Wanguo Wei, Xiaojun Zheng
1 links
Journal of Chemical Education
Educational Assessment and Pedagogy
article

Beyond Point Allocation: Auditing Course-Objective Alignment and Item-Level Performance across a Two-Semester Organic Chemistry Sequence

Yuhui Zhao, Wanguo Wei, Xiaojun Zheng
article en

Abstract

Course-assessment alignment is often judged from a blueprint that shows how many examination points are assigned to each course objective. Such a summary can be reassuring, yet it leaves unanswered what students are actually required to do. This study examined two consecutive final examinations in a 64 h undergraduate organic chemistry course for energy storage engineering majors at a Chinese university. The evidence base combined the official syllabus, examination blueprint, scoring guides, 119 scored subtasks, and regular final-examination records from 84 students in Semester 1 and 83 students in Semester 2. Scored subtasks were coded for course objective, revised-Bloom cognitive demand, organic chemistry task, intended difficulty, and contextual demand; student performance was analyzed at the 38 and 40 parent units for which scores were recorded. Point allocation closely matched the intended 40:60 distribution for Course Objectives 1 and 2 (44:56 and 38:62). In contrast, 99 of 100 points in Semester 1 and all 100 points in Semester 2 could be completed without using production, everyday-life, or engineering context. Item-level results further showed that observed difficulty did not increase monotonically across Bloom categories; several of the lowest score rates occurred on synthesis and selected multistep transformations. The findings show how a layered audit of alignment and student performance can reveal features that point allocation alone does not capture.

Journal of Chemical Education
University of Science and Technology Liaoning (CN), Roche (China) (CN), Liaoning Agricultural Vocational and Technical College (CN)
National Natural Science Foundation of China, Department of Education of Liaoning Province
Quality education
Educational Assessment and Pedagogy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon