Demonstration of a mixed-methods illuminative evaluation: the case of a sports and exercise academic program

Introduction: In sports and exercise science education, ensuring that curricular components translate into practical skills is particularly critical. Higher education programs often struggle to align their instructional design with the actual learning experiences of students. Objective: This study aimed to evaluate the alignment between the instructional system (intended program design) and the learning milieu (implemented experiences) of a sports and exercise science academic program, demonstrating an innovative mixed-methods illuminative evaluation framework. Methodology: A three-phase sequential mixed-methods design was employed. Qualitative interviews with stakeholders were first conducted to identify key program components and themes. A survey instrument was developed based on these qualitative insights and underwent content validation. Finally, the validated survey was administered to current students and alumni, and the data were analyzed using Importance–Performance Analysis. Results: The evaluation found that in-class program elements – including teacher preparation, learning activities, and learning environment – were regarded as highly important and were delivered effectively, indicating strong alignment between the program’s design and student experiences. In contrast, the on-the-job training component showed lower perceived importance and weaker performance. Discussion: These findings mirrored prior research in showing that well-prepared instructors and supportive learning environments enhance student engagement and learning outcomes. The results underscored the persistent challenge of bridging theoretical instruction with practical application in higher education. Conclusions: The study provided actionable recommendations to strengthen the OJT segment of the curriculum and introduced a novel mixed-methods evaluation model. This integrated approach offered alternative assessment of the program and can serve as a blueprint for future evaluations.