How spammers and scammers leverage AI-generated images on Facebook for audience growth

Much of the research and discourse on risks from artificial intelligence (AI) image generators, such as DALL-E and Midjourney, has centered around whether they could be used to inject false information into political discourse. We show that spammers and scammers—seemingly motivated by profit or clout, not ideology—are already using AI-generated images to gain significant traction on Facebook. At times, the Facebook Feed is recommending unlabeled AI-generated images to users who neither follow the Pages posting the images nor realize that the images are AI-generated, highlighting the need for improved transparency and provenance standards as AI models proliferate.

Authors

Institutions

Publication Details

Journal
Harvard Kennedy School Misinformation Review
Published
2024-08-15
DOI
https://doi.org/10.37016/mr-2020-151
Citations
18
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
20.38
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How spammers and scammers leverage AI-generated images on Facebook for audience growth

Renée DiResta, Josh A. Goldstein
18 citations
Harvard Kennedy School Misinformation Review
Misinformation and Its Impacts
20.38
article

How spammers and scammers leverage AI-generated images on Facebook for audience growth

Renée DiResta, Josh A. Goldstein
article en
18 citations

Abstract

Much of the research and discourse on risks from artificial intelligence (AI) image generators, such as DALL-E and Midjourney, has centered around whether they could be used to inject false information into political discourse. We show that spammers and scammers—seemingly motivated by profit or clout, not ideology—are already using AI-generated images to gain significant traction on Facebook. At times, the Facebook Feed is recommending unlabeled AI-generated images to users who neither follow the Pages posting the images nor realize that the images are AI-generated, highlighting the need for improved transparency and provenance standards as AI models proliferate.

Harvard Kennedy School Misinformation Review
Georgetown University (US), Center for Security and Emerging Technology (US), Stanford University (US)
Openalex Percentile: Top 1%
Misinformation and Its Impacts
20.38
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.