Assessing strategic use of artificial intelligence in self-regulated learning: Instrument development and evidence from Chinese university students

Despite the rapid integration of AI into students’ self-regulated learning, rigorously validated instruments to assess their strategic AI use are critically lacking. Addressing this gap, the present study proposes a conceptual framework of self-regulated use of AI for learning, based on which a strategy inventory was developed and validated in two questionnaire surveys among Chinese university students (with valid n = 488 and 707 respectively). Factor and Rasch analyses of the data identified eight factors underlying the instrument, with four pertaining to the regulation of AI-assisted task processing, and another four associated with the regulation of AI application. The corresponding subscales also demonstrated robust psychometric properties. Quantitative analyses further revealed imbalanced strategy usage. Specifically, output-focused metacognitive regulation was reported to be most frequent, whereas AI-supported self-assessment strategies were underutilized. Results also showed that there were gender and academic disciplinary differences in ethical and tool-focused metacognitive regulation; while degree of AI exposure was positively correlated with most strategy types, it had no significant correlation with ethical regulation. These findings highlight the need for differentiated interventions to address populational gaps in the AI-mediated learning process. This study contributes to a structured approach to understanding AI’s role in self-regulated learning and calls for concerted measures to cultivate students’ metacognitive and ethical awareness in AI application. Pedagogically, the validated instrument can be used by teachers to diagnose students’ strategy use and inform targeted instruction. Students can also use it for self-assessment, enhancing their self-awareness and fostering a more balanced use of different AI strategies.

Authors

Institutions

Publication Details

Journal
International Journal of Educational Technology in Higher Education
Published
2025-11-20
DOI
https://doi.org/10.1186/s41239-025-00567-5
Citations
5
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
12.40

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Assessing strategic use of artificial intelligence in self-regulated learning: Instrument development and evidence from Chinese university students

Danling Li, Yangyu Xiao, Liu Xiao-hua
5 citations
International Journal of Educational Technology in Higher Education
AI in Service Interactions
12.40
article

Assessing strategic use of artificial intelligence in self-regulated learning: Instrument development and evidence from Chinese university students

Danling Li, Yangyu Xiao, Liu Xiao-hua
article en
5 citations

Abstract

Despite the rapid integration of AI into students’ self-regulated learning, rigorously validated instruments to assess their strategic AI use are critically lacking. Addressing this gap, the present study proposes a conceptual framework of self-regulated use of AI for learning, based on which a strategy inventory was developed and validated in two questionnaire surveys among Chinese university students (with valid n = 488 and 707 respectively). Factor and Rasch analyses of the data identified eight factors underlying the instrument, with four pertaining to the regulation of AI-assisted task processing, and another four associated with the regulation of AI application. The corresponding subscales also demonstrated robust psychometric properties. Quantitative analyses further revealed imbalanced strategy usage. Specifically, output-focused metacognitive regulation was reported to be most frequent, whereas AI-supported self-assessment strategies were underutilized. Results also showed that there were gender and academic disciplinary differences in ethical and tool-focused metacognitive regulation; while degree of AI exposure was positively correlated with most strategy types, it had no significant correlation with ethical regulation. These findings highlight the need for differentiated interventions to address populational gaps in the AI-mediated learning process. This study contributes to a structured approach to understanding AI’s role in self-regulated learning and calls for concerted measures to cultivate students’ metacognitive and ethical awareness in AI application. Pedagogically, the validated instrument can be used by teachers to diagnose students’ strategy use and inform targeted instruction. Students can also use it for self-assessment, enhancing their self-awareness and fostering a more balanced use of different AI strategies.

International Journal of Educational Technology in Higher EducationVol. 22(1)
Shenzhen University (CN), Chinese University of Hong Kong, Shenzhen (CN)
Chinese University of Hong Kong, Jilin Office of Philosophy and Social Science
Openalex Percentile: Top 2%
AI in Service Interactions
12.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.