Development and Psychometric Validation of a Computer-Based Higher-Order Thinking Skills Assessment Instrument for Table Tennis Education

This research seeks to create and validate a computer-based assessment tool for HOTS in table tennis education, aiming to thoroughly evaluate students' cognitive competencies in tactical and strategic scenarios. Employing a Research and Development (R&D) design based on the ADDIE model, the study developed a 60-item computer-based assessment addressing three cognitive domains: analysis, evaluation, and synthesis/creativity. The instrument underwent extensive validation through expert reviews and psychometric evaluations, including content validity index, reliability analysis (Cronbach's alpha), and exploratory factor analysis. The research involved 120 undergraduate physical education students with prior table tennis background, utilizing pre- and post-assessment techniques to measure the intervention's effectiveness. The resulting assessment tool exhibited strong content validity (CVI = 0.89) and high reliability (α = 0.91). Factor analysis validated the three-domain model, accounting for 67.8% of variance. There was a notable improvement in student performance across all cognitive domains post-intervention, particularly in analysis (Cohen's d = 0.82). System usability was positively rated (mean SUS = 78.4), indicating favorable user acceptance and technical efficacy. This study contributes a valid, reliable, and user-friendly computer-based HOTS assessment for table tennis, enhancing pedagogical methods in sports education. It not only evaluates but also fosters students' higher-order cognitive abilities, promoting a comprehensive development framework integrating cognitive and physical training. Future research should investigate wider applications in various sports and the long-term educational effects.