Detecting AI-Generated Text and Assessing Citation Integrity in Scholarly Communication: A Scoping Review of Methods, Limitations, and Manipulation

Large language models complicate text-origin assessment and increase risks from nonexistent, inaccurate, or strategically used citations. This scoping review maps methods for detecting AI-generated or substantially AI-modified text and for evaluating reference integrity and citation manipulation in scholarly communication. We searched Scopus and Web of Science Core Collection on 31 August 2026, and IEEE Xplore on 2 September 2026. Four thematic search streams yielded 1633 records after filters. Following deduplication, removal of five 2027 records, citation searching, title-and-abstract screening, and full-text assessment, 71 peer-reviewed publications were retained; 69 formed the main synthesis and two provided conceptual background. Detection approaches included statistical signals, conventional machine learning, transformer classifiers, stylometry, watermarking, retrieval, and process-based provenance. Performance varied across generators, domains, languages, text lengths, paraphrases, and mixed human–AI texts, limiting the evidentiary value of a single detector score. Citation-integrity studies addressed fabricated or inaccurate references, claim–source agreement, citation function, coercion, cartels, stacking, self-citation, paper mills, and metadata manipulation. On the basis of this mapped evidence, we propose a layered conceptual audit combining provenance, targeted detection, bibliographic verification, claim-level checking, and network or metadata analysis. The integrated workflow itself has not yet been empirically validated, and consequential decisions should remain subject to documented human review.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-11-05
DOI
https://doi.org/10.3390/app162110958
Primary Topic
Academic integrity and plagiarism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Detecting AI-Generated Text and Assessing Citation Integrity in Scholarly Communication: A Scoping Review of Methods, Limitations, and Manipulation

Karol Wieczorek, Daniel Kaczmarski
Applied Sciences
Academic integrity and plagiarism
article

Detecting AI-Generated Text and Assessing Citation Integrity in Scholarly Communication: A Scoping Review of Methods, Limitations, and Manipulation

Karol Wieczorek, Daniel Kaczmarski
article en

Abstract

Large language models complicate text-origin assessment and increase risks from nonexistent, inaccurate, or strategically used citations. This scoping review maps methods for detecting AI-generated or substantially AI-modified text and for evaluating reference integrity and citation manipulation in scholarly communication. We searched Scopus and Web of Science Core Collection on 31 August 2026, and IEEE Xplore on 2 September 2026. Four thematic search streams yielded 1633 records after filters. Following deduplication, removal of five 2027 records, citation searching, title-and-abstract screening, and full-text assessment, 71 peer-reviewed publications were retained; 69 formed the main synthesis and two provided conceptual background. Detection approaches included statistical signals, conventional machine learning, transformer classifiers, stylometry, watermarking, retrieval, and process-based provenance. Performance varied across generators, domains, languages, text lengths, paraphrases, and mixed human–AI texts, limiting the evidentiary value of a single detector score. Citation-integrity studies addressed fabricated or inaccurate references, claim–source agreement, citation function, coercion, cartels, stacking, self-citation, paper mills, and metadata manipulation. On the basis of this mapped evidence, we propose a layered conceptual audit combining provenance, targeted detection, bibliographic verification, claim-level checking, and network or metadata analysis. The integrated workflow itself has not yet been empirically validated, and consequential decisions should remain subject to documented human review.

Applied SciencesVol. 16(21)
Kielce University of Technology (PL)
Openalex Percentile: Top 9%
Academic integrity and plagiarism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon