Development and psychometric evaluation of a multimedia quality assessment tool for health education and promotion through mixed methods

Health strategies primarily aim to improve public health, a goal increasingly supported by multimedia resources that enhance learning and audience satisfaction. Despite their significant influence on health literacy, quality standards for producing and disseminating such multimedia materials remain under-researched. This study aimed to develop and validate a comprehensive tool for assessing the quality of multimedia resources in health education and promotion. This methodological study employed a two-phase explanatory sequential mixed-methods approach. It began with a scoping review to evaluate the initial item pool, followed by a qualitative phase utilizing semi-structured interviews with 22 health, media, and communication professionals to generate additional items. The subsequent quantitative phase rigorously assessed the instrument's validity and reliability using McDonald's omega (ω) and the Intraclass Correlation Coefficient (ICC). Combining findings from the scoping review and qualitative phase (which covered content quality, aesthetics, communication, and effectiveness) resulted in 131 initial items. After rigorous validation, this pool was reduced to a final 64-item questionnaire featuring 10 factors, including text/image/sound quality, layout, interactivity, behavior focus, and credibility. The tool demonstrated excellent reliability, with an overall McDonald's omega of 0.95 and an ICC between raters of 0.86. The developed 64-item questionnaire exhibits acceptable validity and reliability, establishing it as a useful, comprehensive instrument that empowers specialists and stakeholders to enhance the design and assessment of multimedia health education resources, ultimately contributing to improved community health.