Questionable research practices in the use of AI

Artificial Intelligence is rapidly being integrated into research workflows, but its use is not free from risks and questionable practices. This presentation explores the emerging spectrum of questionable research practices (QRPs) in AI, ranging from fundamental technical tricks in machine learning—such as data contamination, cherrypicking, and misreporting—to the misuse of AI in scientific writing, peer review, and grant applications. Specific cases include prompt injections in peer review, breaches of confidentiality through AI-assisted reviewing, “AI-giarism” (plagiarism with AI-generated text), fabricated citations, and the uncritical acceptance of AI outputs. These practices pose significant risks to research integrity, data protection, confidentiality, and trust in science. The talk highlights concrete examples, recent studies, and guidelines from organizations such as UKRIO and the DFG, and concludes with reflections on how researchers and institutions can safeguard integrity while responsibly integrating AI into their work.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-09-04
DOI
https://doi.org/10.5281/zenodo.17055055
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Questionable research practices in the use of AI

Zenodo (CERN European Organization for Nuclear Research)
Geochemistry and Geologic Mapping
article

Questionable research practices in the use of AI

article en

Abstract

Artificial Intelligence is rapidly being integrated into research workflows, but its use is not free from risks and questionable practices. This presentation explores the emerging spectrum of questionable research practices (QRPs) in AI, ranging from fundamental technical tricks in machine learning—such as data contamination, cherrypicking, and misreporting—to the misuse of AI in scientific writing, peer review, and grant applications. Specific cases include prompt injections in peer review, breaches of confidentiality through AI-assisted reviewing, “AI-giarism” (plagiarism with AI-generated text), fabricated citations, and the uncritical acceptance of AI outputs. These practices pose significant risks to research integrity, data protection, confidentiality, and trust in science. The talk highlights concrete examples, recent studies, and guidelines from organizations such as UKRIO and the DFG, and concludes with reflections on how researchers and institutions can safeguard integrity while responsibly integrating AI into their work.

Zenodo (CERN European Organization for Nuclear Research)
University of Mannheim (DE)
Quality Education
Openalex Percentile: Top 54%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Questionable research practices in the use of AI · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS