CritiQAL: Critiquing via questions and answers for assurance of learning

CritiQAL is a structured viva-based assessment design built using Generative Artificial Intelligence (GenAI) to support assurance of learning. The key idea behind CritiQAL is to exercise students’ evaluative judgement – that is, the ability to assess and evaluate the quality of explanations or solutions. It was implemented in Trimester 1, 2026 in SIT796 Reinforcement Learning, a technical unit in Artificial Intelligence at Deakin University with a cohort of 139 postgraduate students. The tool was trained on unit materials to generate questions and suggest answers aligned to unit content, with parts of a suggested answer intentionally constructed to be incorrect. Students were tasked with answering questions and critiquing suggested answers, shifting the task from simple recall towards evaluation, justification and explanation. CritiQAL was used to conduct a viva task from week six onwards, with a full, half or zero-point rubric, where students were required to accumulate five points by Week 11. This paper outlines the rationale, design and implementation of CritiQAL as a practical response for assurance of learning in a context increasingly shaped by GenAI.

Authors

Institutions

Publication Details

Journal
ASCILITE Publications
Published
2026-11-17
DOI
https://doi.org/10.65106/apubs.2026.3084
Primary Topic
Artificial Intelligence in Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

CritiQAL: Critiquing via questions and answers for assurance of learning

Thommen George Karimpanal
3 links
ASCILITE Publications
Artificial Intelligence in Education
article

CritiQAL: Critiquing via questions and answers for assurance of learning

Thommen George Karimpanal
article en

Abstract

CritiQAL is a structured viva-based assessment design built using Generative Artificial Intelligence (GenAI) to support assurance of learning. The key idea behind CritiQAL is to exercise students’ evaluative judgement – that is, the ability to assess and evaluate the quality of explanations or solutions. It was implemented in Trimester 1, 2026 in SIT796 Reinforcement Learning, a technical unit in Artificial Intelligence at Deakin University with a cohort of 139 postgraduate students. The tool was trained on unit materials to generate questions and suggest answers aligned to unit content, with parts of a suggested answer intentionally constructed to be incorrect. Students were tasked with answering questions and critiquing suggested answers, shifting the task from simple recall towards evaluation, justification and explanation. CritiQAL was used to conduct a viva task from week six onwards, with a full, half or zero-point rubric, where students were required to accumulate five points by Week 11. This paper outlines the rationale, design and implementation of CritiQAL as a practical response for assurance of learning in a context increasingly shaped by GenAI.

ASCILITE Publications
Deakin University (AU)
Quality education
Artificial Intelligence in Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon