Video-administered questionnaire: Psychometric properties and comparison with a text-based format

Short videos have become popular online content. This study experimentally examined the feasibility of presenting items of an online psychological questionnaire as short videos (VQ) and compared this method to a traditional text-based administration (TQ) using a convenient online sample of N = 321. VQ was administered either by a male (VQ M ) or a female (VQ F ) interviewer. Strict measurement invariance was established across both methods for both inventories used. No significant differences emerged in the methods' break-off rate, reliability, or criterion validity. Respondents' self-reported ability to focus did not differ between VQ and TQ. Similarly, no differences between the methods were found in an attempt to measure respondent's focus objectively. It seems that neither the social desirability nor the interviewer effect had any notable negative influence on VQ. The completion time was faster in VQ M but not VQ F compared to TQ, suggesting that video administration is not necessarily slower. Respondents rated VQ as the more enjoyable method. There was also a visible improvement in model fit indices in the VQ over TQ for both employed inventories. The results of this exploratory study imply that videos could be an advantageous form of psychological questionnaire administration, although replication is necessary. • We propose a new format for administering online questionnaires. • Items are presented as short videos; responses use a 5-point Likert Scale. • Strict measurement invariance across formats was confirmed. • No differences in descriptives, reliability, break-off rate, or criterion validity. • Video questionnaires are not necessarily slower to complete.