Jämförelse av kvalitet på AI:s och lärarassistenters återkoppling i en introduktionskurs i programmering

This study has explored what comments OpenAI’s model gpt-4.1 makes on the coding assignments belonging to first year computer science students at KTH and compared the comments to feedback given by TAs. The intent was to determine if the AI-generated feedback contained enough correct information to potentially replace TAs. As of this AI-model, although parts of the generated feedback could be helpful to TAs when grading assignments, such as positive comments, gpt-4.1 has been proven to not work well enough to be trusted for independently grading assignments. The generated feedback did not find logical errors in the code that the TAs found, resulting in the AI passing assignments that, according to TAs, needed more work to receive a passing grade. Nevertheless, another later model could possibly be able to give proper feedback on student assignments in the future.