Tracing the development of multimodal representational competence in science reading: a longitudinal eye-tracking study across grades 4–6

Reading science texts requires students to actively engage in meaning-making processes by coordinating multiple semiotic resources, specifically texts and diagrams. However, the development of multimodal representational competence remains largely unexplored. To address this gap, this three-year longitudinal eye-tracking study examined the trajectories of science reading comprehension and eye-movement indicators of multimodal representational competence among 175 students from Grade 4 to Grade 6. Utilizing latent basis growth curve modeling, the analysis revealed a distinct non-linear developmental mismatch between students’ multimodal navigation strategies and their comprehension scores. From Grade 4 to Grade 5, text-to-diagram saccades per page decreased slightly, and comprehension temporarily declined. Conversely, by Grade 6, these integration strategies plateaued while comprehension improved substantially. Furthermore, text mean fixation durations grew progressively longer across the grades, consistent with a strategic slowing to accommodate the escalating conceptual difficulty of science materials. Additionally, baseline reading ability positively predicted initial comprehension but did not significantly predict the growth slope of integration strategies. These findings suggest that text-diagram integration has yet to become habitual in these grades. Consequently, effective science education necessitates explicit pedagogical interventions targeting multimodal representational competence to bridge general literacy with domain-specific scientific meaning-making.

Authors

Institutions

Publication Details

Journal
International Journal of Science Education
Published
2026-11-12
DOI
https://doi.org/10.1080/09500693.2026.2759984
Primary Topic
Visual and Cognitive Learning Processes
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Tracing the development of multimodal representational competence in science reading: a longitudinal eye-tracking study across grades 4–6

Chao‐Jung Wu, Yu‐Cin Jian, Hsaio-Hui Lin
International Journal of Science Education
Visual and Cognitive Learning Processes
article

Tracing the development of multimodal representational competence in science reading: a longitudinal eye-tracking study across grades 4–6

Chao‐Jung Wu, Yu‐Cin Jian, Hsaio-Hui Lin
article en

Abstract

Reading science texts requires students to actively engage in meaning-making processes by coordinating multiple semiotic resources, specifically texts and diagrams. However, the development of multimodal representational competence remains largely unexplored. To address this gap, this three-year longitudinal eye-tracking study examined the trajectories of science reading comprehension and eye-movement indicators of multimodal representational competence among 175 students from Grade 4 to Grade 6. Utilizing latent basis growth curve modeling, the analysis revealed a distinct non-linear developmental mismatch between students’ multimodal navigation strategies and their comprehension scores. From Grade 4 to Grade 5, text-to-diagram saccades per page decreased slightly, and comprehension temporarily declined. Conversely, by Grade 6, these integration strategies plateaued while comprehension improved substantially. Furthermore, text mean fixation durations grew progressively longer across the grades, consistent with a strategic slowing to accommodate the escalating conceptual difficulty of science materials. Additionally, baseline reading ability positively predicted initial comprehension but did not significantly predict the growth slope of integration strategies. These findings suggest that text-diagram integration has yet to become habitual in these grades. Consequently, effective science education necessitates explicit pedagogical interventions targeting multimodal representational competence to bridge general literacy with domain-specific scientific meaning-making.

International Journal of Science Education
National Taiwan Normal University (TW)
National Taiwan Normal University, Institute for Research Excellence in Learning Sciences, National Taiwan Normal University
Quality education
Visual and Cognitive Learning Processes
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon