Automated Assessment: Does It Align With Teachers' Views?

In Aotearoa New Zealand, assessment of programming for the national NCEA standards is carried out manually by teachers, many of whom are not experienced programmers. In an attempt to decrease teacher workload, we have adapted Moodle CodeRunner [23] to assess a widely used recently released high school programming standard. This paper explores in detail how we have automated each criterion of the new standard, including dealing with judgement calls for the more subjective criteria.