Validating the assessment of an out-of-class listening task using Rasch analysis

There has been increasing interest in recent years in the use of out-of-class and extensive listening and various studies have explored its efficacy. However, there has been relatively little research into the appropriate methods of assessment for such tasks. Therefore, this study aims to explore the effectiveness of the assessment methods for out-of-class listening in use at a university in Japan. The test instrument used is a post-listening multiple-choice test, completed without the use of notes. A Rasch analysis was used to investigate test validation, and the results suggest that the test is valid, but there are areas for improvement in terms of reliability and distractor functioning. Implications for the assessment of out-of-class listening are discussed based on these findings. Keywords: out-of-class listening, Rasch measurement, assessment validation, multiple-choice tests, listening assessment