Practice Still Makes Proficient: A Replication of Kershaw et al. (2018, 2023; Kershaw & Gordon, 2024) Using an Alternate Form of the Journal Article Comprehension Assessment

Background Recent research suggests that empirical research comprehension can be improved through structured assignments that distribute deliberate practice opportunities over the semester. Objective This recent research used identical Journal Article Comprehension (JAC) assessments of this structured practice in a pretest/posttest design. The current study's aim was to develop an alternate form of the JAC assessment. Method Across four semesters, 125 students completed one form of the JAC at the pretest and another at the posttest. These different forms were matched on question type and answer options. Results All groups improved in empirical research comprehension between the pretest and posttest, as shown through the total JAC score. This improvement occurred regardless of which combination of JAC articles they received at the pretest or posttest. Conclusion The findings suggest that both JACs are equivalent measures of empirical research comprehension. The current results also replicate past research showing overall improvement, that improvement is not just a practice effect, and that improvement can occur with only a few practice opportunities. Teaching Implications The equivalence of the new form of the JAC gives educators an alternate way to assess empirical research comprehension within the context of a semester or to assess the transfer of skills across the curriculum.