AI for scientific integrity: detecting ethical breaches, errors, and misconduct in manuscripts
The use of Generative AI (GenAI) in scientific writing has grown rapidly, offering tools for manuscript drafting, literature summarization, and data analysis. However, these benefits are accompanied by risks, including undisclosed AI authorship, manipulated content, and the emergence of papermills. This perspective examines two key strategies for maintaining research integrity in the GenAI era: (1) detecting unethical or inappropriate use of GenAI in scientific manuscripts and (2) using AI tools to identify mistakes in scientific literature, such as statistical errors, image manipulation, and incorrect citations. We reviewed the capabilities and limitations of existing AI detectors designed to differentiate human-written (HWT) from machine-generated text (MGT), highlighting performance gaps, genre sensitivity, and vulnerability to adversarial attacks. We also investigate emerging AI-powered systems aimed at identifying errors in published research, including tools for statistical verification, citation validation, and image manipulation detection. Additionally, we discuss recent publishing industry initiatives to AI-driven papermills. Our investigation shows that these developments are not yet sufficiently accurate or reliable yet for use in academic assessment, they mark an early but promising steps toward scalable, AI-assisted quality control in scholarly publishing.
Authors
- Diogo Pellegrina (ORCID: https://orcid.org/0000-0001-6423-5093)
- Mohamed Helmy (ORCID: https://orcid.org/0000-0002-9561-7956)
Institutions
- Idaho State University (US)
- Agency for Science, Technology and Research (SG)
- University of Saskatchewan (CA)
- Bioinformatics Institute (SG)
Publication Details
- Journal
- Frontiers in Artificial Intelligence
- Published
- 2025-09-02
- DOI
- https://doi.org/10.3389/frai.2025.1644098
- Citations
- 3
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.96
Funders
- Innovation Saskatchewan