AI-Powered MicroApps for Online Assessments: Impacts on Efficiency, Quality, and Future Directions

In the evolving landscape of educational technology, integrating Artificial Intelligence (AI) into educational assessment creation has emerged as a key area of innovation. This paper compares three methods for generating Multiple Choice Questions (MCQs): (1) without the use of generative AI, (2) with unguided usage of ChatGPT, and (3) with a specialized AI-powered micro-app designed specifically for MCQ generation. The micro-app, named the "MCQ Generator", allows users to set preferences such as difficulty level, number of distractors, and inclusion of hints/feedback, tailoring the final prompt based on these selections. Our study involves instructional designers creating MCQs for hypothetical courses, with educators then evaluating the quality of these questions using a rubric-based approach. The results reveal that AI-assisted methods significantly enhance the efficiency and quality of MCQ generation compared to non-AI methods. Notably, the micro-app demonstrates potential advantages over ChatGPT, offering a more user-friendly interface and a lower barrier to entry for educators. These findings suggest that while ChatGPT can enhance the MCQ creation process, AI micro-apps may provide more tailored functionalities that further streamline educators’ workflows. This paper presents empirical evidence on the utility of AI in educational content development. By doing so, it contributes to the broader discourse on the transformative potential of AI in educational assessment, with a particular focus on online education. Additionally, it explores methods to increase AI adoption within the field.