Feasibility Study of Augmenting Teaching Assistants with AI for CS1 Programming Feedback
With the increasing adoption of Large Language Models (LLMs), there are proposals to replace human Teaching Assistants (TAs) with LLM-based AI agents for providing feedback to students. In this paper, we explore a new hybrid model where human TAs receive AI-generated feedback for CS1 programming exercises, which they can then review and modify as needed. We conducted a large-scale randomized intervention with 185 CS1 undergraduate students, comparing the efficacy of this hybrid approach against manual feedback and direct AI-generated feedback.
Authors
- Ben Leong (ORCID: https://orcid.org/0000-0003-1738-5958)
- Amey Karkare (ORCID: https://orcid.org/0000-0002-3664-6490)
- Umair Z. Ahmed (ORCID: https://orcid.org/0000-0002-2203-7301)
- Shubham Sahai
Institutions
- National University of Singapore (SG)
- Indian Institute of Technology Kanpur (IN)
Publication Details
- Published
- 2025-02-12
- DOI
- https://doi.org/10.1145/3641554.3701972
- Citations
- 7
- Primary Topic
- Teaching and Learning Programming
- Type
- article
- Field-Weighted Citation Impact
- 11.86