Effects of Self-Explanation Strategies and Panoramic Video on Learning Outcomes: A Multimodal Data Analysis

The purpose of this study was to investigate the effects of different types of videos and self-explanation strategies on learning engagement and performance. Ninety-six college students were randomly assigned to one of the four conditions in a 2 × 2 factorial design with videos (panoramic vs. regular) and self-explanation prompts (open-ended vs. structured) as the between-subjects factors. Neurosky mindwave mobile and Tobii pro X3-120 eye-tracker were used to measure participants' learning engagement. Learning performance was measured with retention and transfer tests. The results revealed that (a) panoramic video significantly improved transfer test scores and the total fixation count; (b) structured self-explanation strategies significantly facilitated retention test scores and learning engagement-meditation, the total fixation count, and the mean fixation duration-in the learning process; and (c) the combination of panoramic video and structured self-explanation strategies led participants to focus more deeply on the learning process. This research provides some implications for instructional designers of panoramic videos.