Developing GenAI-Based Feedback Through Iterative Prompt Design: An Exploratory Study of Online Students’ Cognitive, Affective, and Behavioral Perceptions
This study reports the iterative prompt-engineering development of Generative Artificial Intelligence (GenAI)-based feedback in an online graduate course and examines students’ cognitive, affective, and behavioral perceptions. Grounded in the Student–Feedback Interaction Model, a qualitative case study involved 14 graduate students in a 14-week fully online course on open and distance learning. Students completed forum-based formative activities and received instructor-reviewed GenAI feedback. Informed by expert review, instructor observations, and student reflections, prompts evolved through three stages: checklist-style criterion verification, criteria-anchored synthesized explanations, and personalized diagnosis of strengths and weaknesses. Semi-structured interviews were analyzed through qualitative content analysis. Students reported improved feedback comprehensibility, detail, tone, and timeliness, valuing personalized, explanatory, criterion-based comments. However, inconsistencies between AI comments and instructor scores, limited conceptual evaluation, and lack of emotional presence weakened trust. GenAI therefore functions best as a draft-generation layer requiring sustained, active instructor oversight rather than as a stand-alone source of formative feedback.
Authors
- Ömer Arpacık (ORCID: https://orcid.org/0000-0002-4400-9299)
- Sinem Çilligöl Karabey (ORCID: https://orcid.org/0000-0002-8925-9486)
- Meva Bayrak Karsli (ORCID: https://orcid.org/0000-0002-9062-6482)
- Engin Kurşun (ORCID: https://orcid.org/0000-0002-5649-8595)
- Ebubekir Kaba (ORCID: https://orcid.org/0000-0002-6661-6225)
- Muhammed Guler (ORCID: https://orcid.org/0000-0001-5353-2690)
- Melike Aydemir Arslan
Institutions
- Atatürk University (TR)
Publication Details
- Journal
- Applied Measurement in Education
- Published
- 2026-10-15
- DOI
- https://doi.org/10.1080/08957347.2026.2738700
- Primary Topic
- Student Assessment and Feedback
- Type
- article
- Field-Weighted Citation Impact
- 0.00