Initial Psychometric Evaluation of the Problematic Use of Generative Artificial Intelligence Scale Among Chinese School Students

Generative artificial intelligence (GAI) is increasingly used by school students, yet validated instruments for assessing problematic GAI use (PUGAI) in this population remain scarce. This study evaluated the psychometric properties of the Problematic Use of Generative Artificial Intelligence Scale (PUGAIS) in a large school-based sample of Chinese students. A cross-sectional survey included 19,484 students in Grades 4–9 who had used GAI. The sample was randomly split for exploratory and confirmatory factor analyses. Internal consistency, measurement invariance across sex, school type, and developmentally defined age groups, concurrent validity, latent classes, and a preliminary threshold were also examined. Following item refinement, the 8-item PUGAIS (PUGAIS-8) showed a dominant one-factor structure, although confirmatory model-fit evidence was mixed. The scale showed high internal consistency (Cronbach’s α = 0.940) and measurement invariance of item thresholds and factor loadings across sex, school type, and age groups. Ordinal sensitivity analyses indicated that the item-reduction results were partly sensitive to analytic treatment, although the PUGAIS-8 showed a more favorable overall structural fit than the original 10-item specification. A substantial floor effect indicated limited differentiation at the lower end of the construct. PUGAIS-8 scores were positively associated with depressive symptoms, anxiety symptoms, insomnia symptoms, and short-video addiction (r = 0.365–0.413, all p < 0.01). Latent class analysis identified a high-score subgroup (7.2%), and an exploratory ROC analysis yielded an internally derived descriptive threshold of 20.5. Overall, the findings provide initial psychometric support for the PUGAIS-8 as a brief measure of PUGAI among Chinese school students, while indicating the need for independent replication of the item-reduction findings and further evaluation of its measurement properties and proposed threshold.

Authors

Institutions

Publication Details

Journal
Behavioral Sciences
Published
2026-09-28
DOI
https://doi.org/10.3390/bs16101763
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Initial Psychometric Evaluation of the Problematic Use of Generative Artificial Intelligence Scale Among Chinese School Students

Hongtao Shao, Joseph T. F. Lau, Yang Wang, Deborah Baofeng Wang et al.
Behavioral Sciences
Artificial Intelligence in Healthcare and Education
article

Initial Psychometric Evaluation of the Problematic Use of Generative Artificial Intelligence Scale Among Chinese School Students

Hongtao Shao, Joseph T. F. Lau, Yang Wang, Deborah Baofeng Wang, Jiamin Huang, Yanqiu Yu, Xiaohan Liu, Hongsheng Yang, Mei Peng, Tingjun Ye
article en

Abstract

Generative artificial intelligence (GAI) is increasingly used by school students, yet validated instruments for assessing problematic GAI use (PUGAI) in this population remain scarce. This study evaluated the psychometric properties of the Problematic Use of Generative Artificial Intelligence Scale (PUGAIS) in a large school-based sample of Chinese students. A cross-sectional survey included 19,484 students in Grades 4–9 who had used GAI. The sample was randomly split for exploratory and confirmatory factor analyses. Internal consistency, measurement invariance across sex, school type, and developmentally defined age groups, concurrent validity, latent classes, and a preliminary threshold were also examined. Following item refinement, the 8-item PUGAIS (PUGAIS-8) showed a dominant one-factor structure, although confirmatory model-fit evidence was mixed. The scale showed high internal consistency (Cronbach’s α = 0.940) and measurement invariance of item thresholds and factor loadings across sex, school type, and age groups. Ordinal sensitivity analyses indicated that the item-reduction results were partly sensitive to analytic treatment, although the PUGAIS-8 showed a more favorable overall structural fit than the original 10-item specification. A substantial floor effect indicated limited differentiation at the lower end of the construct. PUGAIS-8 scores were positively associated with depressive symptoms, anxiety symptoms, insomnia symptoms, and short-video addiction (r = 0.365–0.413, all p < 0.01). Latent class analysis identified a high-score subgroup (7.2%), and an exploratory ROC analysis yielded an internally derived descriptive threshold of 20.5. Overall, the findings provide initial psychometric support for the PUGAIS-8 as a brief measure of PUGAI among Chinese school students, while indicating the need for independent replication of the item-reduction findings and further evaluation of its measurement properties and proposed threshold.

Behavioral SciencesVol. 16(10)
Chinese University of Hong Kong (HK), Fudan University (CN), Wenzhou Medical University (CN), First Affiliated Hospital of Wenzhou Medical University (CN)
Quality Education
Openalex Percentile: Top 15%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.