Beyond Access: How GenAI Literacy Relates to Task Performance, Motivation, Cognitive Load and Interaction Patterns in AI ‐Assisted Learning Environment

ABSTRACT Background Generative AI is rapidly being integrated into educational settings, yet equitable benefits depend heavily on students' GenAI literacy. While access to these tools is increasing, empirical evidence remains limited on how specific dimensions of assessed GenAI literacy relate to students' task performance, cognitive experiences, and actual interactional behaviours during learning. Objectives This study examined the associations of overall GenAI literacy and its four dimensions (Know and Understand, Use and Apply, Evaluate and Create, Ethics) with students' abstract‐writing performance, self‐efficacy, motivation, and cognitive load. It also explored how assessed literacy is reflected in the configurations of students' interactions with GenAI. Methods A total of 162 university students completed an abstract‐writing task using a custom GenAI assistant. Ordinary least‐squares regression models evaluated the continuous GenAI literacy scores against writing performance, motivation, and cognitive load, adjusting for prior academic writing knowledge and English proficiency. Additionally, Epistemic Network Analysis (ENA) was applied to conversational trace data to compare the configurations of questioning and commanding behaviours between higher‐ and lower‐literacy students. Results and Conclusions Higher overall GenAI literacy was positively associated with better writing performance and negatively associated with perceived mental load. Dimension‐level analyses revealed distinct roles: the Use and Apply dimension was independently associated with higher writing performance, while the Know and Understand dimension was uniquely associated with lower mental load. Neither the total score nor the sub‐dimensions showed reliable associations with motivation or self‐efficacy. Furthermore, ENA profiles demonstrated that higher‐literacy students engaged in a refinement‐oriented process, whereas lower‐literacy students relied predominantly on direct content generation and factual retrieval. These findings suggest that instruction should address both conceptual understanding and practical application of GenAI, helping students critically evaluate and refine AI‐generated content during writing.

Authors

Institutions

Publication Details

Journal
Journal of Computer Assisted Learning
Published
2026-10-30
DOI
https://doi.org/10.1002/jcal.70367
Primary Topic
Artificial Intelligence in Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond Access: How GenAI Literacy Relates to Task Performance, Motivation, Cognitive Load and Interaction Patterns in AI ‐Assisted Learning Environment

Angxuan Chen, Huaiya Liu, Jiyou Jia, Jingjing LIAN et al.
5 links
Journal of Computer Assisted Learning
Artificial Intelligence in Education
article

Beyond Access: How GenAI Literacy Relates to Task Performance, Motivation, Cognitive Load and Interaction Patterns in AI ‐Assisted Learning Environment

Angxuan Chen, Huaiya Liu, Jiyou Jia, Jingjing LIAN, Chunlei Ren
article en

Abstract

ABSTRACT Background Generative AI is rapidly being integrated into educational settings, yet equitable benefits depend heavily on students' GenAI literacy. While access to these tools is increasing, empirical evidence remains limited on how specific dimensions of assessed GenAI literacy relate to students' task performance, cognitive experiences, and actual interactional behaviours during learning. Objectives This study examined the associations of overall GenAI literacy and its four dimensions (Know and Understand, Use and Apply, Evaluate and Create, Ethics) with students' abstract‐writing performance, self‐efficacy, motivation, and cognitive load. It also explored how assessed literacy is reflected in the configurations of students' interactions with GenAI. Methods A total of 162 university students completed an abstract‐writing task using a custom GenAI assistant. Ordinary least‐squares regression models evaluated the continuous GenAI literacy scores against writing performance, motivation, and cognitive load, adjusting for prior academic writing knowledge and English proficiency. Additionally, Epistemic Network Analysis (ENA) was applied to conversational trace data to compare the configurations of questioning and commanding behaviours between higher‐ and lower‐literacy students. Results and Conclusions Higher overall GenAI literacy was positively associated with better writing performance and negatively associated with perceived mental load. Dimension‐level analyses revealed distinct roles: the Use and Apply dimension was independently associated with higher writing performance, while the Know and Understand dimension was uniquely associated with lower mental load. Neither the total score nor the sub‐dimensions showed reliable associations with motivation or self‐efficacy. Furthermore, ENA profiles demonstrated that higher‐literacy students engaged in a refinement‐oriented process, whereas lower‐literacy students relied predominantly on direct content generation and factual retrieval. These findings suggest that instruction should address both conceptual understanding and practical application of GenAI, helping students critically evaluate and refine AI‐generated content during writing.

Journal of Computer Assisted LearningVol. 42(6)
Beijing University of Posts and Telecommunications (CN), Peking University (CN), University of Cambridge (GB)
Peking University
Quality education
Openalex Percentile: Top 6%
Artificial Intelligence in Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon