Feasibility Study of Augmenting Teaching Assistants with AI for CS1 Programming Feedback

With the increasing adoption of Large Language Models (LLMs), there are proposals to replace human Teaching Assistants (TAs) with LLM-based AI agents for providing feedback to students. In this paper, we explore a new hybrid model where human TAs receive AI-generated feedback for CS1 programming exercises, which they can then review and modify as needed. We conducted a large-scale randomized intervention with 185 CS1 undergraduate students, comparing the efficacy of this hybrid approach against manual feedback and direct AI-generated feedback.

Authors

Institutions

Publication Details

Published
2025-02-12
DOI
https://doi.org/10.1145/3641554.3701972
Citations
7
Primary Topic
Teaching and Learning Programming
Type
article
Field-Weighted Citation Impact
11.86
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Feasibility Study of Augmenting Teaching Assistants with AI for CS1 Programming Feedback

Ben Leong, Amey Karkare, Umair Z. Ahmed, Shubham Sahai
7 citations
Teaching and Learning Programming
11.86
article

Feasibility Study of Augmenting Teaching Assistants with AI for CS1 Programming Feedback

Ben Leong, Amey Karkare, Umair Z. Ahmed, Shubham Sahai
article en
7 citations

Abstract

With the increasing adoption of Large Language Models (LLMs), there are proposals to replace human Teaching Assistants (TAs) with LLM-based AI agents for providing feedback to students. In this paper, we explore a new hybrid model where human TAs receive AI-generated feedback for CS1 programming exercises, which they can then review and modify as needed. We conducted a large-scale randomized intervention with 185 CS1 undergraduate students, comparing the efficacy of this hybrid approach against manual feedback and direct AI-generated feedback.

National University of Singapore (SG), Indian Institute of Technology Kanpur (IN)
Openalex Percentile: Top 2%
Teaching and Learning Programming
11.86
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.