Bidirectional Feedback-Based Personalization of Learning using Multi-tier AI: A Real-World Assessment of its Efficacy in Classrooms

Jill Watson is an example of an intelligent conversational AI Teaching Assistant that has been deployed across 24 class sections in different institutions, with 1102 unique student participants and over 17000 questions from Fall 2023 to present. Jill Watson’s RAG-based architecture built around OpenAI ChatGPT and user study results addresses some of the concerns related to domain knowledge, deployment, and data collection in online classrooms. In this work, a 3-tiered framework for personalization in online education using AI tools to enable a human-AI personalization loop, grounded in real-world human feedback is proposed.