Cognitive Models ofPolycode Texts: A Comprehensive Analysis

Polycode texts, which combine verbal and non-verbal elements, are increasingly prevalent in modern communication. This study investigates the cognitive models underlying the comprehension of polycode texts, aiming to elucidate the mental processes involved in integrating multiple semiotic systems. Using a mixed-methods approach, we conducted experiments with 120 participants (Mage = 28.5, SD = 4.2) to assess their comprehension of various polycode texts. Eye-tracking data and think-aloud protocols were collected and analyzed using both quantitative and qualitative methods. Results indicate that successful polycode text comprehension involves a complex interplay of visual attention, verbal processing, and cognitive integration. A novel "Integrated Polycode Comprehension Model" (IPCM) is proposed, synthesizing elements from dual coding theory and cognitive load theory. The IPCM suggests that comprehension is optimized when verbal and non-verbal elements are semantically congruent and spatially proximate. Furthermore, individual differences in cognitive styles significantly influenced comprehension patterns. These findings have important implications for the design of educational materials, user interfaces, and multimodal communication strategies. Future research directions and practical applications are discussed.