The Architecture Matrix: Tools, Black Boxes, and the Procurement of Primary Educational AI
The international community has converged on a shared diagnosis of the risks that black-box AI systems pose to transparency, equity,and human oversight in education. UNESCO’s 2026 volume The Algorithm in the Room documents these risks and calls for agencyand pedagogy to come first. What remains absent is the operational standard that translates this diagnosis into testable procurementrequirements. This letter draws a distinction that existing frameworks imply but have not made explicit: the difference betweenAI deployed as a bounded tool and AI deployed as an architecture that tracks and steers learning trajectories over time. It furtherdistinguishes between transparent systems and opaque black-boxes. These axes yield a 2×2 matrix and a single procurement question:does the system track the child, and can it account for its decisions? In primary education, where children lack the developmentalcapacity to challenge algorithmic decisions, this is not a design preference but an ethical boundary. Drawing on empirical and policyevidence, we argue that black-box AI cannot serve as educational architecture. We recommend mandating transparent, teacher-governedsystems for any technology that steers a child’s learning. Black-box AI can assist, it cannot govern.
Authors
- Thierry Geoffre (ORCID: https://orcid.org/0000-0003-0237-2310)
- Trystan Geoffre (ORCID: https://orcid.org/0009-0006-2481-0982)
- Zheng Yuan
- Qiao Wang
Publication Details
- Published
- 2026-10-28
- DOI
- https://doi.org/10.35542/osf.io/thvd2_v1
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- preprint