Development of an online global education evaluation scale

Purpose After the COVID-19 pandemic accelerated online global education, this study developed a practical online global education evaluation scale. With collaborative online international learning as an exemplar of online exchange, this study aims to examine key measurement properties (factor structure, internal consistency and construct validity) to address difficulties in evaluating intercultural learning and to support quality assurance in online international education. Design/methodology/approach Item generation and expert review produced a 41-item pool. Content validity was assessed by six experts (S-CVI/Ave = 0.95). An online survey was administered to 263 students across five programs in three countries; 128 responses were analyzed. Exploratory and confirmatory factor analyses, multitrait scaling and internal consistency analyses were conducted. Findings The final scale contains 21 items across four factors: Objective understanding of global issues, understanding of global issues using digital skills, active communication and considering solutions. Model fit was acceptable (CFI = 0.885; RMSEA = 0.096). Scaling success was 89–100%. Reliability was high (Cronbach’s alpha = 0.94 overall; 0.85–0.92 for subscales). Originality/value The scale provides a validated, context-specific measure of learning outcomes in online global education and can be used to guide program improvement and to compare outcomes across courses and contexts as part of quality assurance in higher education.

Authors

Institutions

Publication Details

Journal
Quality Assurance in Education
Published
2026-07-30
DOI
https://doi.org/10.1108/qae-01-2026-0042
Primary Topic
Global Education and Multiculturalism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of an online global education evaluation scale

Andi Masyitha Irwan, Rui Ota, Peii Tsai, Ryota Ochiai et al.
Quality Assurance in Education
Global Education and Multiculturalism
article

Development of an online global education evaluation scale

Andi Masyitha Irwan, Rui Ota, Peii Tsai, Ryota Ochiai, Ngai Weng Chan, Fumihiko Omori, Thi Bich Ngoc Pham, Takashi Yoshinaga, Hidefumi Imura, Yasumasa SHOJI, Akio Onishi, Nguyen Thien Huong Dang, Masahiko Nakanishi
article en

Abstract

Purpose After the COVID-19 pandemic accelerated online global education, this study developed a practical online global education evaluation scale. With collaborative online international learning as an exemplar of online exchange, this study aims to examine key measurement properties (factor structure, internal consistency and construct validity) to address difficulties in evaluating intercultural learning and to support quality assurance in online international education. Design/methodology/approach Item generation and expert review produced a 41-item pool. Content validity was assessed by six experts (S-CVI/Ave = 0.95). An online survey was administered to 263 students across five programs in three countries; 128 responses were analyzed. Exploratory and confirmatory factor analyses, multitrait scaling and internal consistency analyses were conducted. Findings The final scale contains 21 items across four factors: Objective understanding of global issues, understanding of global issues using digital skills, active communication and considering solutions. Model fit was acceptable (CFI = 0.885; RMSEA = 0.096). Scaling success was 89–100%. Reliability was high (Cronbach’s alpha = 0.94 overall; 0.85–0.92 for subscales). Originality/value The scale provides a validated, context-specific measure of learning outcomes in online global education and can be used to guide program improvement and to compare outcomes across courses and contexts as part of quality assurance in higher education.

Quality Assurance in Education
Vietnam National University Ho Chi Minh City (VN), Universiti Sains Malaysia (MY), Meiji University (JP), Kyushu Institute of Technology (JP), Tokyo College of Environment (JP), Kyushu Art Institute of Technology (JP), Yokohama City University (JP), Hasanuddin University (ID)
Openalex Percentile: Top 3%
Global Education and Multiculturalism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.