False Positives in Artificial Intelligence Detectors and Their Impact on Academic Quality Assurance: A Systematic Review

Generative artificial intelligence has transformed assessment in higher education, accelerating the adoption of automated text classifiers to uphold academic integrity; nonetheless, their diagnostic reliability remains contested due to systemic algorithmic biases. This systematic review synthesizes empirical evidence on the incidence of false positives in AI-generated text detectors, their algorithmic and sociolinguistic drivers, and their broader ramifications for institutional quality assurance. Following the PRISMA 2020 guidelines and eligibility criteria based on the SPICE framework, searches were conducted in Web of Science, Scopus, and SciELO, resulting in a qualitative and narrative synthesis of 30 primary empirical studies; the protocol was registered in OSF. Preliminary results from the studies indicate that current detectors rely heavily on reductionist probabilistic metrics, such as perplexity and burstiness, which frequently misclassify structured academic discourse and non-native English writing as synthetic text. Furthermore, the synthesized evidence points to the possibility that punitive enforcement may disproportionately disadvantage specific linguistic cohorts, potentially exacerbating assessment anxiety and compromising evaluative equity. The review suggests that relying exclusively on automated AI detection represents a documented institutional vulnerability for assessment fairness and academic quality assurance, particularly within English-medium higher education contexts where these tools are most extensively implemented.

Authors

Publication Details

Journal
Journal of Education and Training Studies
Published
2026-10-28
DOI
https://doi.org/10.11114/jets.v15i1.9451
Primary Topic
Academic integrity and plagiarism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

False Positives in Artificial Intelligence Detectors and Their Impact on Academic Quality Assurance: A Systematic Review

Wilson Alexander Zambrano Vélez, Rosa Elena Niola Sanmartín, Eduardo Fabio Henríquez Mendoza, Rudy Jonathan Párraga Solórzano et al.
Journal of Education and Training Studies
Academic integrity and plagiarism
article

False Positives in Artificial Intelligence Detectors and Their Impact on Academic Quality Assurance: A Systematic Review

Wilson Alexander Zambrano Vélez, Rosa Elena Niola Sanmartín, Eduardo Fabio Henríquez Mendoza, Rudy Jonathan Párraga Solórzano, Gioryi Augusto Sornoza Zavala, Eliana Geomar Leon Abad
article en

Abstract

Generative artificial intelligence has transformed assessment in higher education, accelerating the adoption of automated text classifiers to uphold academic integrity; nonetheless, their diagnostic reliability remains contested due to systemic algorithmic biases. This systematic review synthesizes empirical evidence on the incidence of false positives in AI-generated text detectors, their algorithmic and sociolinguistic drivers, and their broader ramifications for institutional quality assurance. Following the PRISMA 2020 guidelines and eligibility criteria based on the SPICE framework, searches were conducted in Web of Science, Scopus, and SciELO, resulting in a qualitative and narrative synthesis of 30 primary empirical studies; the protocol was registered in OSF. Preliminary results from the studies indicate that current detectors rely heavily on reductionist probabilistic metrics, such as perplexity and burstiness, which frequently misclassify structured academic discourse and non-native English writing as synthetic text. Furthermore, the synthesized evidence points to the possibility that punitive enforcement may disproportionately disadvantage specific linguistic cohorts, potentially exacerbating assessment anxiety and compromising evaluative equity. The review suggests that relying exclusively on automated AI detection represents a documented institutional vulnerability for assessment fairness and academic quality assurance, particularly within English-medium higher education contexts where these tools are most extensively implemented.

Journal of Education and Training StudiesVol. 15(1)
Openalex Percentile: Top 7%
Academic integrity and plagiarism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
False Positives in Artificial Intelligence Detectors and Their Impact on Academic Quality Assurance: A Systematic Review — Wilson Alexander Zambrano Vélez, Rosa Elena Niola Sanmartín, et al. · Journal of Education and Training Studies (2026) | TGRS Research Map | TGRS