Cognitive Verification Cost: A Qualitative-Quantitative Metric for Academic Evaluation in the Age of Generative AI
Most prior studies on academic evaluation focus on output quality, plagiarism detection techniques and evaluation system design, and generally treat verification as an incidental cost within review workflows. Gipp, B. (2014). Citation-Based Plagiarism Detection. Springer proposes a homology identification framework built on citation patterns, which identifies disguised plagiarism through citation sequences and placement rather than surface-level textual features, and acknowledges the inherent difficulty of detecting conceptual homology. Weber-Wulff, D., et al. (2023). Benchmarking AI-Generated Text Detection Tools in Academic Writing: An Experimental Evaluation. International Journal for Educational Integrity. Centered on distinguishing human-authored and machine-generated texts, academic integrity risks arising from inappropriate AI use, tool reliability and ethical limits, this research concentrates on textual properties at the output stage. It recognises the necessity of human oversight in review, yet does not model the cognitive expenditure involved in tracing knowledge genealogies and attributing originality from the perspective of reviewer cognitive load. Tennant, J. P. (2018). The state of the art in peer review. F1000Research. This paper notes that rising manuscript volumes exacerbate review pressure. Existing discussions of cost mostly address author-side production costs and flaws in appraisal mechanisms, while reviewer burden is only described empirically in terms of time constraints and workload saturation. Foucault’s archaeology of knowledge urges researchers to trace shared underlying presuppositions of discourse. Simon’s bounded rationality theory was originally formulated for individual decision-making. Under AI conditions, the core tension of university innovation assessment has shifted. The primary constraint is no longer the cost of producing outputs, but cognitive verification cost. This study defines cognitive verification cost based on cognitive structure models and categorises sources of innovation into endogenous cognitive innovation by the agent and innovation enabled by valid AI deployment. It adopts the cognitive maturity index as the medium for cognitive practice verification, and classifies users into three archetypes: AI dominators, AI dependants and AI bystanders, to explain disparities in cognitive verification cost across user groups. The framework reframes the vague construct of expert review burden into an evaluative system that conducts qualitative analysis across three tiers: surface textual homology, meso-structural homology and underlying paradigmatic homology, supplemented by numerical weights for cognitive verification. It addresses challenges posed by latent conceptual homology and low-similarity AI-generated submissions. The core judgement procedures of this study still rely on expert agents and cannot fully detach from human subjective cognition.
Authors
- Yung Hsu (ORCID: https://orcid.org/0009-0005-3902-7264)
Publication Details
- Journal
- Open Science Framework
- Published
- 2026-11-13
- DOI
- https://doi.org/10.17605/osf.io/w9vyx
- Primary Topic
- Academic integrity and plagiarism
- Type
- article
- Field-Weighted Citation Impact
- 0.00