Computer or Paper-Based Delivery Mode: An Analysis for Testing English Reading Strategies

This study aims to examine the comparability of scores on the Reading Comprehension Exam (EDI for its acronym in Spanish) with institutional multiple-choice items in two administration modes, namely paper-based tests and computer-based tests, taken by first-year Costa Rican students from different majors at the University of Costa Rica, Costa Rica. The analysis considered both types of administration by comparing test per- formance and conducting item differential analysis (DIF) among 1145 students during February 2023. Findings revealed that differences between both administration modes are minimal and weak. Furthermore, when differences, they indicate a slight advan- tage of computer-based over paper-based administration. This study exemplifies how to leverage computer-based testing without adversely affecting candidates by adapting a measurement instrument from paper to digital format.