From Traces to Teaching: A Socio-Technical Framework for Process-Based Assessment in an Age of Distributed Cognition

Generative AI severs the link between polished products and genuine learning, exposing the limits of outcome-only assessment. This paper advances a socio-technical framework for AI-enabled process-based assessment (PBA) that reframes evaluation as continuous diagnosis embedded in learning. A five-stage pipeline—task → trace → model → feedback → validation—aligns pedagogical intent with instrumentation of interaction, discourse, and multimodal evidence, and treats the human–AI pair as the unit of analysis within a distributed cognition perspective. Methodologically, the framework maps trace types to appropriate model families (e.g., sequential pattern mining, HMMs, NLP) while requiring explainability so insights are actionable. For practice, it specifies teacher–AI orchestration roles that preserve human judgment and defines governance protocols for privacy, fairness, transparency, and cultural responsiveness. The result is a principled route to assess complex problem solving with integrity in the age of generative AI.

Authors

Institutions

Publication Details

Journal
Artificial Intelligence Education Studies
Published
2025-09-10
DOI
https://doi.org/10.6914/aiese.010304
Citations
1
Primary Topic
Cognitive Science and Mapping
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Traces to Teaching: A Socio-Technical Framework for Process-Based Assessment in an Age of Distributed Cognition

Alexander LEE
1 citations
Artificial Intelligence Education Studies
Cognitive Science and Mapping
2.48
article

From Traces to Teaching: A Socio-Technical Framework for Process-Based Assessment in an Age of Distributed Cognition

Alexander LEE
article en
1 citations

Abstract

Generative AI severs the link between polished products and genuine learning, exposing the limits of outcome-only assessment. This paper advances a socio-technical framework for AI-enabled process-based assessment (PBA) that reframes evaluation as continuous diagnosis embedded in learning. A five-stage pipeline—task → trace → model → feedback → validation—aligns pedagogical intent with instrumentation of interaction, discourse, and multimodal evidence, and treats the human–AI pair as the unit of analysis within a distributed cognition perspective. Methodologically, the framework maps trace types to appropriate model families (e.g., sequential pattern mining, HMMs, NLP) while requiring explainability so insights are actionable. For practice, it specifies teacher–AI orchestration roles that preserve human judgment and defines governance protocols for privacy, fairness, transparency, and cultural responsiveness. The result is a principled route to assess complex problem solving with integrity in the age of generative AI.

Artificial Intelligence Education StudiesVol. 1(3)
Chinese Journal of Integrated Traditional and Western Medicine (CN)
Openalex Percentile: Top 9%
Cognitive Science and Mapping
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.