Beyond the Submit Button: Counterfactual Reconstruction, Metacognition, and Visible Reasoning in AI-Mediated Learning.

Generative artificial intelligence (GenAI) can produce fluent academic work without establishing that students performed the reasoning a submission appears to represent. This study examines how assessment can distinguish student reasoning from its written reconstruction and from the intellectual work supplied by AI. Across 14 structured AI-supported assignments, students submitted a Core Reference Extract (CRE), a concise, student-authored metacognitive reconstruction of consequential reasoning, alongside the full interaction transcript. An instructor-aligned audit generated a constrained counterfactual CRE: the strongest faithful reconstruction supported by the student’s demonstrated contributions in the transcript, evaluated against assignment requirements and disciplinary criteria. Comparing these representations disclosed three recurring relationships: the CRE understated reasoning demonstrated in the dialogue; a polished CRE overstated student control where AI supplied much of the intellectual architecture; or the CRE faithfully represented inquiry governed by student judgment despite substantial AI assistance. The contribution is a method for testing the evidentiary warrant of a submission, not a means of detecting AI use or independently observing cognition. It distinguishes subject-matter reasoning, metacognitive reconstruction, and evaluative governance, and shows how their misalignment can direct grading and feedback. AI organizes and reconstructs process evidence; the instructor retains responsibility for the interpretation and consequential assessment judgment.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-18
DOI
https://doi.org/10.5281/zenodo.24183577
Primary Topic
Artificial Intelligence in Education
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Beyond the Submit Button: Counterfactual Reconstruction, Metacognition, and Visible Reasoning in AI-Mediated Learning.

Lars R. Jones
2 links
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Education
preprint

Beyond the Submit Button: Counterfactual Reconstruction, Metacognition, and Visible Reasoning in AI-Mediated Learning.

Lars R. Jones
preprint en

Abstract

Generative artificial intelligence (GenAI) can produce fluent academic work without establishing that students performed the reasoning a submission appears to represent. This study examines how assessment can distinguish student reasoning from its written reconstruction and from the intellectual work supplied by AI. Across 14 structured AI-supported assignments, students submitted a Core Reference Extract (CRE), a concise, student-authored metacognitive reconstruction of consequential reasoning, alongside the full interaction transcript. An instructor-aligned audit generated a constrained counterfactual CRE: the strongest faithful reconstruction supported by the student’s demonstrated contributions in the transcript, evaluated against assignment requirements and disciplinary criteria. Comparing these representations disclosed three recurring relationships: the CRE understated reasoning demonstrated in the dialogue; a polished CRE overstated student control where AI supplied much of the intellectual architecture; or the CRE faithfully represented inquiry governed by student judgment despite substantial AI assistance. The contribution is a method for testing the evidentiary warrant of a submission, not a means of detecting AI use or independently observing cognition. It distinguishes subject-matter reasoning, metacognitive reconstruction, and evaluative governance, and shows how their misalignment can direct grading and feedback. AI organizes and reconstructs process evidence; the instructor retains responsibility for the interpretation and consequential assessment judgment.

Zenodo (CERN European Organization for Nuclear Research)
Florida Institute of Technology (US)
Quality education
Artificial Intelligence in Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon