A CEFR-Informed English Test: How Content Validity Index and Content Validity Ratio are used for Content Validation

Current education roadmap in Malaysia has seen enormous initiatives taken by the government to ensure the education system is at par with the international standard where the English syllabus and assessments are tailored according to the Common European Framework of Reference (CEFR). This includes higher learning institutions, thus this research aimed to develop the English entrance test that is CEFR-informed. 11 CEFR experts were involved in the study where they reviewed 60 multiple choice questions for reading, grammar and reading comprehension. The results showed that all items were accepted and valid based on the computation of Content Validity Index (CVI) and Content Validity Ratio (CVR). The lowest CVI recorded was .82 with S-CVI of .95 and the lowest CVR was .64 which were above the suggested cut-off value by experts and research. The study concluded that all the items were carefully developed based on the framework and the needs of the test.