How Ready Are Students to Using ChatGPT? A Study on Instrument Validity and Reliability

This study reports the construct validity and reliability of an instrument designed to measure students’ behavioral intention to use ChatGPT. The instrument is developed based on the Unified Theory of Acceptance and Use of Technology (UTAUT) model. Data were collected from 65 undergraduate students of the Faculty of Information Management at UiTM Puncak Perdana using proportionate stratified sampling. Analyses conducted with SPSS and Smart PLS confirmed that the instrument demonstrated acceptable construct validity and moderate reliability. Internal consistency values included Cronbach’s alpha (0.810–0.929), composite reliability (0.70–0.90), and average variance extracted above 0.50. Model accuracy and relevance (R² and Q²) were within acceptable and moderate ranges, with no collinearity issues detected. Content validity was further established using CVI, S-CVI, and S-CVI/Ave, which exceeded 0.80, indicating strong agreement. Overall, the instrument achieved robust validity and reliability, offering a useful inventory for future research on ChatGPT adoption in education.

Institutions

Publication Details

Journal
Journal of Information and Knowledge Management
Published
2025-10-01
DOI
https://doi.org/10.24191/jikm.v15i2.9051
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How Ready Are Students to Using ChatGPT? A Study on Instrument Validity and Reliability

Journal of Information and Knowledge Management
Artificial Intelligence in Healthcare and Education
article

How Ready Are Students to Using ChatGPT? A Study on Instrument Validity and Reliability

article en

Abstract

This study reports the construct validity and reliability of an instrument designed to measure students’ behavioral intention to use ChatGPT. The instrument is developed based on the Unified Theory of Acceptance and Use of Technology (UTAUT) model. Data were collected from 65 undergraduate students of the Faculty of Information Management at UiTM Puncak Perdana using proportionate stratified sampling. Analyses conducted with SPSS and Smart PLS confirmed that the instrument demonstrated acceptable construct validity and moderate reliability. Internal consistency values included Cronbach’s alpha (0.810–0.929), composite reliability (0.70–0.90), and average variance extracted above 0.50. Model accuracy and relevance (R² and Q²) were within acceptable and moderate ranges, with no collinearity issues detected. Content validity was further established using CVI, S-CVI, and S-CVI/Ave, which exceeded 0.80, indicating strong agreement. Overall, the instrument achieved robust validity and reliability, offering a useful inventory for future research on ChatGPT adoption in education.

Journal of Information and Knowledge ManagementVol. 15(2)
University of Selangor (MY), Universiti Teknologi MARA System (MY), Selangor Business School (MY)
Quality Education
Openalex Percentile: Top 42%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.