Investigating the Real-World Relevance of an Academic English Speaking Test: Extrapolating Subjective Evaluations and Linguistic Performance Characteristics

To support use of tests in academic contexts, it is critical to demonstrate that test scores and test performances are associated with performance in academic settings—an inferential link referred to as extrapolation in argument-based validation frameworks. TOEFL Essentials is a newer test designed to measure both general and academic English and is intended for use in higher education. The TOEFL Essentials speaking section consists of Virtual Interview, Read Aloud, and Listen & Repeat tasks, the latter two of which elicit highly constrained responses that may be less reflective of academic speaking tasks. In this study, we examined correlations of scores and linguistic characteristics across TOEFL Essentials speaking performances and (a) lab-based academic tasks (graph description, lecture response) for 149 students and (b) an authentic course-based speaking task for 65 students. Strong correlations (.65 < r < .80) were found between TOEFL Essentials speaking scores and evaluations of academic speaking. Among linguistic characteristics, fluency and accuracy variables demonstrated the largest and most consistent correlations across test and non-test tasks. Findings provide evidence relevant to the extrapolation of TOEFL Essentials speaking performances, which are based in part on highly constrained tasks, to academic settings and help inform decisions about test use.