Validity Architecture for AI Integrated Assessment (VAAI): A Conceptual Framework for Defensible Assessment Practice

Generative AI has weakened the link between submitted work and warranted claims about learner competence, creating an inference problem that detection and prohibition alone cannot resolve. This article introduces the Validity Architecture for AI Integrated Assessment (VAAI), a conceptual framework for redesigning assessment when AI assistance may shape student work. Grounded in argument-based validity and construct validity theory, VAAI treats AI-related assessment challenges as problems of inference, evidence, and interpretation rather than primarily as problems of academic integrity. For practitioners, it organizes assessment design around five questions: what claim is being made, what evidence can support it, what AI assistance is compatible with the claim, how scoring and fairness should be handled, and when the assessment must be reviewed. VAAI combines a maturity scale across eight dimensions with an evidence model centred on provenance, adversarial rebuttal testing, and consequence-calibrated implementation. Worked examples from nursing, counselling, and program-level capstone review illustrate how the same validity logic applies across disciplines and consequence levels. The article contributes a structured validity architecture for making interpretive claims, assistance boundaries, and evidentiary requirements more explicit, contestable, and defensible in higher education assessment practice.

Authors

Institutions

Publication Details

Journal
Intersection A Journal at the Intersection of Assessment and Learning
Published
2026-06-29
DOI
https://doi.org/10.61669/001c.164280
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Validity Architecture for AI Integrated Assessment (VAAI): A Conceptual Framework for Defensible Assessment Practice

Johanathan Woodworth, Mohamed Kharbach, Christine Doe
Intersection A Journal at the Intersection of Assessment and Learning
Artificial Intelligence in Healthcare and Education
article

Validity Architecture for AI Integrated Assessment (VAAI): A Conceptual Framework for Defensible Assessment Practice

Johanathan Woodworth, Mohamed Kharbach, Christine Doe
article en

Abstract

Generative AI has weakened the link between submitted work and warranted claims about learner competence, creating an inference problem that detection and prohibition alone cannot resolve. This article introduces the Validity Architecture for AI Integrated Assessment (VAAI), a conceptual framework for redesigning assessment when AI assistance may shape student work. Grounded in argument-based validity and construct validity theory, VAAI treats AI-related assessment challenges as problems of inference, evidence, and interpretation rather than primarily as problems of academic integrity. For practitioners, it organizes assessment design around five questions: what claim is being made, what evidence can support it, what AI assistance is compatible with the claim, how scoring and fairness should be handled, and when the assessment must be reviewed. VAAI combines a maturity scale across eight dimensions with an evidence model centred on provenance, adversarial rebuttal testing, and consequence-calibrated implementation. Worked examples from nursing, counselling, and program-level capstone review illustrate how the same validity logic applies across disciplines and consequence levels. The article contributes a structured validity architecture for making interpretive claims, assistance boundaries, and evidentiary requirements more explicit, contestable, and defensible in higher education assessment practice.

Intersection A Journal at the Intersection of Assessment and Learning
Mount Saint Vincent University (CA)
Quality Education
Openalex Percentile: Top 10%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.