Analyzing the Validity of an Assessment Instrument for a TOEIC Preparation Class

This study was conducted to gather validity evidence for the midterm test used in a university TOEIC preparation class and examine its correlation with TOEIC test results. The test consisted of 44 multiple-choice questions modeled on the TOEIC format with two item types: part of speech (POS), and vocabulary and other grammar (VOG). The results of Rasch analysis indicated that the test had adequate item targeting, although the items did not form a unidimensional scale, suggesting that POS and VOG measured distinct constructs. While POS items correlated more strongly with TOEIC scores, the VOG questions need improvement. The results highlight the importance of aligning test content with instructional focus.