Does Generative Artificial Intelligence Improve Students’ Higher-Order Thinking? A Meta-Analysis Based on 29 Experiments and Quasi-Experiments
The widespread application of Generative Artificial Intelligence (Gen-AI) is transforming educational practices and driving pedagogical innovation. While cultivating higher-order thinking (HOT) represents a central educational goal, its achievement remains an ongoing challenge. Current evidence regarding the impact of Gen-AI on HOT is relatively fragmented, lacking systematic integration, particularly in the analysis of moderating variables. To address this gap, a meta-analysis approach was employed, integrating data from 29 experimental and quasi-experimental studies to quantitatively assess the overall impact of Gen-AI on learners' HOT and to examine potential moderating factors. The analysis revealed that Gen-AI exerts a moderate positive effect on HOT, with the most significant improvement observed in problem-solving abilities, followed by critical thinking, while its effect on creativity is relatively limited. Moderation analyses further indicated that the impact of Gen-AI is significantly influenced by experimental duration and learners' self-regulated learning (SRL) abilities: effects were strongest when interventions lasted 8-16 weeks, and learners with higher SRL capacities benefited more substantially. Based on the research findings, this study proposed that Gen-AI should be systematically integrated as a targeted instructional tool to foster HOT. Medium- to long-term interventions (8-16 weeks) are recommended to enhance learners' problem-solving and critical thinking abilities. At the same time, effective approaches should also be explored to promote creative thinking through Gen-AI within existing pedagogical frameworks. Furthermore, individual learner differences should be accounted for by adopting dynamic and personalized scaffolding strategies to foster SRL, thereby maximizing the educational potential of Gen-AI in cultivating innovative talents.
Authors
- Yan Zhao (ORCID: https://orcid.org/0000-0002-4588-6752)
- Qiang Jiang (ORCID: https://orcid.org/0000-0001-9396-8325)
- Gangsheng Li
- Zhonghua Sun
- Yue Yuan (ORCID: https://orcid.org/0000-0003-1749-998X)
Institutions
- Northeast Normal University (CN)
- Changchun Normal University (CN)
- Ocean University of China (CN)
Publication Details
- Journal
- Journal of Intelligence
- Published
- 2025-12-05
- DOI
- https://doi.org/10.3390/jintelligence13120160
- Citations
- 2
- Primary Topic
- Creativity in Education and Neuroscience
- Type
- article
- Field-Weighted Citation Impact
- 4.24
Funders
- National Natural Science Foundation of China
- People's Government of Jilin Province
- Central China Normal University