It’s raining bots: how easier access to internet surveys has created the perfect storm

Online surveys are an increasingly common way to collect data from the public, with social media and financial incentives (e.g. gift cards) commonly used to increase participation rates. Anonymity, ease of response, and the potential to reach diverse demographics have also contributed to the popularity of online surveys. Health services research benefits from the increased accessibility that online survey-based data collection provides; however, fraudulent responses are of concern. The following article describes our team's experience with a national survey of Canadian healthcare providers being overrun with fraudulent responses and approach to ensure the validity of our survey data. We provide recommendations for research teams on how best to design their surveys, work with their institutions to implement safeguards within survey platforms, and screen completed responses. We also describe fraudulent open-text responses that we believe to have been produced with the help of artificial intelligence and are sounding the alarm for other researchers to be aware of this potential threat to data integrity. Informed by the learnings shared, researchers and research institutions can be better equipped to prevent and screen fraudulent responses to continue successfully engage the public in online research.

Authors

Institutions

Publication Details

Journal
BMJ Open Quality
Published
2025-04-01
DOI
https://doi.org/10.1136/bmjoq-2024-003208
Citations
5
Primary Topic
Social Media in Health Education
Type
article
Field-Weighted Citation Impact
10.84

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

It’s raining bots: how easier access to internet surveys has created the perfect storm

Isabelle Caven, Karen Okrainec, Zhisheng Yang
5 citations
BMJ Open Quality
Social Media in Health Education
10.84
article

It’s raining bots: how easier access to internet surveys has created the perfect storm

Isabelle Caven, Karen Okrainec, Zhisheng Yang
article en
5 citations

Abstract

Online surveys are an increasingly common way to collect data from the public, with social media and financial incentives (e.g. gift cards) commonly used to increase participation rates. Anonymity, ease of response, and the potential to reach diverse demographics have also contributed to the popularity of online surveys. Health services research benefits from the increased accessibility that online survey-based data collection provides; however, fraudulent responses are of concern. The following article describes our team's experience with a national survey of Canadian healthcare providers being overrun with fraudulent responses and approach to ensure the validity of our survey data. We provide recommendations for research teams on how best to design their surveys, work with their institutions to implement safeguards within survey platforms, and screen completed responses. We also describe fraudulent open-text responses that we believe to have been produced with the help of artificial intelligence and are sounding the alarm for other researchers to be aware of this potential threat to data integrity. Informed by the learnings shared, researchers and research institutions can be better equipped to prevent and screen fraudulent responses to continue successfully engage the public in online research.

BMJ Open QualityVol. 14(2)
University Health Network (CA), University of Toronto (CA)
Physicians' Services Incorporated Foundation, University of Toronto
Openalex Percentile: Top 2%
Social Media in Health Education
10.84
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

It’s raining bots: how easier access to internet surveys has created the perfect storm — Isabelle Caven, Karen Okrainec, et al. · BMJ Open Quality (2025) | TGRS Research Map | TGRS