Beyond the pretty graph: Human-centred assessment design for evaluative judgement

Assessment in data visualisation courses too often rewards technical output over communicating substance. When visualisation is taught as a tool rather than a discipline, students learn to produce work that meets the brief but has little to say. This paper reports on a course redesign that addresses this gap through a human-centred assessment design grounded in evaluative judgement theory, treating evaluative judgement as a capability exercised by both students and markers. The redesign is structured around five elements addressing student ownership of project topics, portfolio assessment, descriptive capability levels, practitioner modelling, and creative freedom within a structured framework, implemented in a required course within a Master of Data Science program. Practitioner inquiry into the operation of this design in the presence of generative AI revealed that AI functioned not as a threat to academic integrity but as a mechanism that raised creative ambition, shifting the limiting factor from technical skill to evaluative judgement. Although situated in a data visualisation course, the contribution is broader. As generative AI makes technical production easier, helping students develop the capacity to recognise, justify, and communicate insight becomes the central challenge across higher education, and this paper suggests one way to address it.

Authors

Institutions

Publication Details

Journal
ASCILITE Publications
Published
2026-11-17
DOI
https://doi.org/10.65106/apubs.2026.3259
Primary Topic
Student Assessment and Feedback
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Beyond the pretty graph: Human-centred assessment design for evaluative judgement

Josh Chopin, Malgorzata Korolkiewicz
7 links
ASCILITE Publications
Student Assessment and Feedback
article

Beyond the pretty graph: Human-centred assessment design for evaluative judgement

Josh Chopin, Malgorzata Korolkiewicz
article en

Abstract

Assessment in data visualisation courses too often rewards technical output over communicating substance. When visualisation is taught as a tool rather than a discipline, students learn to produce work that meets the brief but has little to say. This paper reports on a course redesign that addresses this gap through a human-centred assessment design grounded in evaluative judgement theory, treating evaluative judgement as a capability exercised by both students and markers. The redesign is structured around five elements addressing student ownership of project topics, portfolio assessment, descriptive capability levels, practitioner modelling, and creative freedom within a structured framework, implemented in a required course within a Master of Data Science program. Practitioner inquiry into the operation of this design in the presence of generative AI revealed that AI functioned not as a threat to academic integrity but as a mechanism that raised creative ambition, shifting the limiting factor from technical skill to evaluative judgement. Although situated in a data visualisation course, the contribution is broader. As generative AI makes technical production easier, helping students develop the capacity to recognise, justify, and communicate insight becomes the central challenge across higher education, and this paper suggests one way to address it.

ASCILITE Publications
Adelaide University (AU), The University of Adelaide (AU)
Quality education
Student Assessment and Feedback
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon