Beyond the bluebook: a calibrated framework for redesigning construct-valid assessment in higher education in the age of generative AI

The rapid proliferation of generative artificial intelligence (GenAI) has complicated the link between what a student submits as evidence of learning and what that student actually knows and can do. In response, this study advances an AI-resilient approach to assessment design through the development of a calibrated framework for redesigning construct-valid assessment, based on a systematic review and synthesis of assessment frameworks and structured approaches. Following PRISMA 2020 reporting guidance, sixteen primary assessment frameworks and structured approaches were identified. The synthesis brought their complementary components together into three interdependent design constructs: authorisation, verification, and accountability. Messick’s unified validity theory provides the conceptual anchor connecting these components to the inference an assessment is intended to support. The synthesis revealed that the central gap in the literature is not a lack of relevant approaches or components, but calibration. This gap informed the development of the Calibrated Framework for AI-Resilient Assessment (AIRA), which proposes that verification and accountability should become stronger and more diverse as authorised GenAI involvement increases or becomes more consequential to the intended construct. The framework provides educators with a guide for designing assessments and evaluating student learning in AI-integrated environments.

Authors

Institutions

Publication Details

Journal
Assessment & Evaluation in Higher Education
Published
2026-10-15
DOI
https://doi.org/10.1080/02602938.2026.2747110
Primary Topic
Student Assessment and Feedback
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond the bluebook: a calibrated framework for redesigning construct-valid assessment in higher education in the age of generative AI

J.M Shalani Dilinika
Assessment & Evaluation in Higher Education
Student Assessment and Feedback
article

Beyond the bluebook: a calibrated framework for redesigning construct-valid assessment in higher education in the age of generative AI

J.M Shalani Dilinika
article en

Abstract

The rapid proliferation of generative artificial intelligence (GenAI) has complicated the link between what a student submits as evidence of learning and what that student actually knows and can do. In response, this study advances an AI-resilient approach to assessment design through the development of a calibrated framework for redesigning construct-valid assessment, based on a systematic review and synthesis of assessment frameworks and structured approaches. Following PRISMA 2020 reporting guidance, sixteen primary assessment frameworks and structured approaches were identified. The synthesis brought their complementary components together into three interdependent design constructs: authorisation, verification, and accountability. Messick’s unified validity theory provides the conceptual anchor connecting these components to the inference an assessment is intended to support. The synthesis revealed that the central gap in the literature is not a lack of relevant approaches or components, but calibration. This gap informed the development of the Calibrated Framework for AI-Resilient Assessment (AIRA), which proposes that verification and accountability should become stronger and more diverse as authorised GenAI involvement increases or becomes more consequential to the intended construct. The framework provides educators with a guide for designing assessments and evaluating student learning in AI-integrated environments.

Assessment & Evaluation in Higher Education
University of Kelaniya (LK), University of Pittsburgh (US)
Openalex Percentile: Top 3%
Student Assessment and Feedback
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.