Precision check: A critical look at the reliability of AI detection

Debates concerning the creativity, ethics, and the changing nature of learning have undoubtedly been triggered by the expanding application of students using generative AI in academia to complete their assignments.These tools raise questions regarding academic integrity.Differentiating between human created assignments and AI written material has become a challenge for educators and institutions.An experiment was conducted to test the efficacy and validity of AI detecting tools.Three tools were tested, GPTZero, Quillbot, and Polygraf AI, using 100 samples that were written by a human, completely written using AI or a combination of both human and AI written material to determine the tools capacity to accurately identify the content's source.

Institutions

Publication Details

Journal
Issues in Information Systems
Published
2025-01-01
DOI
https://doi.org/10.48009/3_iis_2025_2025_132
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Precision check: A critical look at the reliability of AI detection

Issues in Information Systems
Anomaly Detection Techniques and Applications
article

Precision check: A critical look at the reliability of AI detection

article en

Abstract

Debates concerning the creativity, ethics, and the changing nature of learning have undoubtedly been triggered by the expanding application of students using generative AI in academia to complete their assignments.These tools raise questions regarding academic integrity.Differentiating between human created assignments and AI written material has become a challenge for educators and institutions.An experiment was conducted to test the efficacy and validity of AI detecting tools.Three tools were tested, GPTZero, Quillbot, and Polygraf AI, using 100 samples that were written by a human, completely written using AI or a combination of both human and AI written material to determine the tools capacity to accurately identify the content's source.

Issues in Information Systems
Bridge University (SS)
Openalex Percentile: Top 87%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.