Investigating reactivity in L2 listener verbal reports

Abstract In investigating second language (L2) listening, verbal report (VR) can provide direct insight into listeners’ behaviors. However, a concern over this method is its potential for reactivity — that the VR may change (either positively or negatively) the individual’s cognitive processes involved in the task being investigated. Thus far, few studies have examined for reactivity in L2 listener VRs, and none have investigated it from a quantitative perspective, a gap which is addressed in this study. The study involved lower-intermediate to intermediate-level Mandarin-speaking English learners, and it compared the listening comprehension of an experimental group undertaking VRs with that of control groups assessed through recall protocols. No significant impact on comprehension was found for the VRs indicating, by extension, no interference with the listeners’ thought processes, and thus no apparent reactive effect. The study additionally examined for reactivity: (1) among three different VR styles (styles 1 and 2 were mediated styles, with each of these styles mediated in differing ways by researcher prompts, and style 3 was an unmediated VR); and (2) for mediated VRs, in general (the combination of styles 1 and 2). None of the analyses found a significant effect on comprehension. One further analysis, which lacked a control group, though, concluded there was a slight comprehension advantage for one of the mediated VR styles over the other two styles. The study had its limitations, but the findings suggest L2 listener VRs do not generally appear to be reactive, suggesting they are suitable for use by researchers investigating L2 listeners.