New Approaches in the Assessment of Pre-Service Teachers' Scientific Research Skills: Multidimensional-Many Facet Rasch Model Application

This survey study aimed to determine pre-service teachers’ skills in conducting and presenting scientific research process and to examine their peer-scoring behaviors. The participants consisted of 36 pre-service teachers and seven peer raters. The analytical rubric developed by the researchers and the performance task were used to collect data. The multidimensional many-facet Rasch measurement model was employed in data analysis. Rasch analysis was carried out with a fully crossed design. The analyses revealed that the least difficult criterion in the dimension of conducting the scientific research process was to perform data analysis while the most challenging criterion was to determine the research model and sample. In addition, the least difficult criterion in the dimension of making an oral presentation was to ensure the interest and participation of the audience, while the most challenging criterion was to make an effective start. The analysis of the rater facet demonstrated that the most severity rater was R3, while the most leniency rater was R4. The study argues that the multidimensional many-facet Rasch model can be used to present reliability and validity evidence in multidimensional performance evaluations.