Same AI, Different Pathways: Unpacking Mechanisms of AI-Mediated Learning across Discipline-Institution Contexts

Large language models (LLMs) are transforming higher education, yet their learning benefits likely depend on students’ AI literacy and how they prompt and verify AI outputs. This mixed-methods study investigates how AI literacy relates to prompting proficiency and verification behavior, and how these behaviors operate through two mechanisms, trust calibration and extraneous cognitive load, to predict coursework performance across two discipline–institution contexts in Thailand. The author surveyed Design students (n = 221) and Business students (n = 222) and analyzed the data using multigroup structural equation modeling, complemented by thematic analysis of semi-structured interviews. Results indicated that AI literacy significantly predicted both prompting proficiency and verification behavior (p < .001). Prompting proficiency was positively associated with trust calibration, whereas verification behavior was negatively associated with extraneous cognitive load, and the corresponding indirect effects were supported. Context-specific patterns also emerged: in the Design context, verification behavior showed a stronger direct association with task quality, while in the Business context, trust calibration was the stronger predictor of assignment quality. Interview evidence helped explain these differences. Design students used ChatGPT primarily to accelerate ideation and refinement, whereas Business students used it to support structured analysis and to make their work more auditable. Across both contexts, verification functioned as a metacognitive safeguard that reduced overload and stabilized accuracy. These findings suggest that teaching AI literacy in higher education should emphasize rubric-guided prompting, verification routines, and calibrated trust to balance efficiency with deeper engagement, with attention to context-specific pedagogical demands. • Mixed-methods study examining AI-mediated learning in Design and Business education • AI literacy enhances prompting proficiency and verification behavior across contexts • Prompting and verification jointly calibrate trust and reduce extraneous cognitive load • Trust calibration predicts outcomes in Business, verification behavior in Design • Proposes AI literacy as a holistic competence integrating cognition and ethics

Authors

Institutions

Publication Details

Journal
Computers and Education Artificial Intelligence
Published
2026-05-01
DOI
https://doi.org/10.1016/j.caeai.2026.100601
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Same AI, Different Pathways: Unpacking Mechanisms of AI-Mediated Learning across Discipline-Institution Contexts

Qinjie Shen
Computers and Education Artificial Intelligence
Artificial Intelligence in Healthcare and Education
article

Same AI, Different Pathways: Unpacking Mechanisms of AI-Mediated Learning across Discipline-Institution Contexts

Qinjie Shen
article en

Abstract

Large language models (LLMs) are transforming higher education, yet their learning benefits likely depend on students’ AI literacy and how they prompt and verify AI outputs. This mixed-methods study investigates how AI literacy relates to prompting proficiency and verification behavior, and how these behaviors operate through two mechanisms, trust calibration and extraneous cognitive load, to predict coursework performance across two discipline–institution contexts in Thailand. The author surveyed Design students (n = 221) and Business students (n = 222) and analyzed the data using multigroup structural equation modeling, complemented by thematic analysis of semi-structured interviews. Results indicated that AI literacy significantly predicted both prompting proficiency and verification behavior (p < .001). Prompting proficiency was positively associated with trust calibration, whereas verification behavior was negatively associated with extraneous cognitive load, and the corresponding indirect effects were supported. Context-specific patterns also emerged: in the Design context, verification behavior showed a stronger direct association with task quality, while in the Business context, trust calibration was the stronger predictor of assignment quality. Interview evidence helped explain these differences. Design students used ChatGPT primarily to accelerate ideation and refinement, whereas Business students used it to support structured analysis and to make their work more auditable. Across both contexts, verification functioned as a metacognitive safeguard that reduced overload and stabilized accuracy. These findings suggest that teaching AI literacy in higher education should emphasize rubric-guided prompting, verification routines, and calibrated trust to balance efficiency with deeper engagement, with attention to context-specific pedagogical demands. • Mixed-methods study examining AI-mediated learning in Design and Business education • AI literacy enhances prompting proficiency and verification behavior across contexts • Prompting and verification jointly calibrate trust and reduce extraneous cognitive load • Trust calibration predicts outcomes in Business, verification behavior in Design • Proposes AI literacy as a holistic competence integrating cognition and ethics

Computers and Education Artificial Intelligence
Bansomdejchaopraya Rajabhat University (TH)
Quality Education
Openalex Percentile: Top 9%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.