Comparison between Rasch analysis and Classical Test Theory for a Physics questionnaire validation

In academic year 2022/2023 an orientation course was proposed to high school students. The aim of the course was to help students to prepare for an admission test to engineering faculties. In this context, the students took a physics propaedeutical test, and their responses were used to validate the questionnaire by applying the Classical Test Theory. Consequently, a new analysis has been performed using the Rasch model instead. In this paper a comparison between the results of these two different approaches is presented. The outcomes of these methodologies seem to be in a good accordance and the combined use of them can provide more reliable information about either the test and the sample of students. This is particularly important for small samples, such as the one in our analysis.