Content validity evaluation by three expert judges of twenty items on digital inequality in higher education

This article reports the findings of a content validity evaluation conducted through the judgment of three experts on twenty items of the Perception of Justice in Digital Education questionnaire. The experts, coded J01, J02, and J03 to protect their confidentiality, rated each item for relevance, clarity, and adequacy on a four-point scale. Their 180 ratings were examined using the item-level content validity index (I-CVI), scale-level content validity indices, and Aiken’s V. Qualitative observations grouped as J04/J05 were analyzed separately and were not treated as additional numerical ratings. The mean I-CVI was 0.800 for relevance, 0.533 for clarity, and 0.767 for adequacy. Integrating the expert ratings with the qualitative observations and item-domain correspondence led to nine items being assigned high revision priority and eleven medium priority. These findings identify which statements require retention, clarification, separation, or conceptual reassignment before administration to students. The expert-judgment phase evaluates the questionnaire’s content and is distinct from subsequent psychometric analyses of student responses. The ratings were contrasted with item-domain correspondence and the recorded observations. Several difficulties involved absolute wording, combined events, and questions about other students’ circumstances. The proposed revision path distinguishes connectivity incidents, institutional assistance, assessment practices, self-efficacy, and technological anxiety without drawing conclusions about students’ responses.

Authors

Institutions

Publication Details

Journal
REDSA Revista Ecuatoriana de Desarrollo Social y Ambiental
Published
2026-11-16
DOI
https://doi.org/10.66646/redsa-2026/11nov55
Primary Topic
Health Education and Validation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Content validity evaluation by three expert judges of twenty items on digital inequality in higher education

Martín Romero Cruz
REDSA Revista Ecuatoriana de Desarrollo Social y Ambiental
Health Education and Validation
article

Content validity evaluation by three expert judges of twenty items on digital inequality in higher education

Martín Romero Cruz
article en

Abstract

This article reports the findings of a content validity evaluation conducted through the judgment of three experts on twenty items of the Perception of Justice in Digital Education questionnaire. The experts, coded J01, J02, and J03 to protect their confidentiality, rated each item for relevance, clarity, and adequacy on a four-point scale. Their 180 ratings were examined using the item-level content validity index (I-CVI), scale-level content validity indices, and Aiken’s V. Qualitative observations grouped as J04/J05 were analyzed separately and were not treated as additional numerical ratings. The mean I-CVI was 0.800 for relevance, 0.533 for clarity, and 0.767 for adequacy. Integrating the expert ratings with the qualitative observations and item-domain correspondence led to nine items being assigned high revision priority and eleven medium priority. These findings identify which statements require retention, clarification, separation, or conceptual reassignment before administration to students. The expert-judgment phase evaluates the questionnaire’s content and is distinct from subsequent psychometric analyses of student responses. The ratings were contrasted with item-domain correspondence and the recorded observations. Several difficulties involved absolute wording, combined events, and questions about other students’ circumstances. The proposed revision path distinguishes connectivity incidents, institutional assistance, assessment practices, self-efficacy, and technological anxiety without drawing conclusions about students’ responses.

REDSA Revista Ecuatoriana de Desarrollo Social y AmbientalVol. 1(4)
Universidad de Sonora (MX)
Quality education
Health Education and Validation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon