The Weaponization of Generative AI in Disinformation Campaigns

Generative AI reduces the price and speeds up disinformation, allowing multimodal creation and platform coordination in a brief time. This paper is an evaluation of its weaponization using a mixed-methods approach: (1) mass-detection of synthetic content and campaign form in the wild; (2) cross-modal detection and avoidance benchmark in text, image, audio, and video; (3) a preregistered experiment of belief, sharing, and confidence. In early windows, synthetic things spread out more easily, multi-modal composites more often defeat detectors, and exposure down-regulates the accuracy of belief and enhances sharing intent. Ensembles are also better detectors, although they perform poorly in realistic laundering (paraphrase, compression, re-recording, cross-modal remix). The network analysis indicates bridge accounts as the major cross-platform conduits. Our suggestions include provenance-by-default, calibrated detectors, coordination wasting, and human-in-the-loop validation of consequential claims. Results can be used in platform policy, election integrity protection, and multilingual risk monitoring in adaptive adversary efforts worldwide.

Authors

Institutions

Publication Details

Journal
Global Political Review
Published
2025-10-23
DOI
https://doi.org/10.31703/gpr.2025(x-iii).15
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Weaponization of Generative AI in Disinformation Campaigns

Amrat Haq
Global Political Review
Misinformation and Its Impacts
article

The Weaponization of Generative AI in Disinformation Campaigns

Amrat Haq
article en

Abstract

Generative AI reduces the price and speeds up disinformation, allowing multimodal creation and platform coordination in a brief time. This paper is an evaluation of its weaponization using a mixed-methods approach: (1) mass-detection of synthetic content and campaign form in the wild; (2) cross-modal detection and avoidance benchmark in text, image, audio, and video; (3) a preregistered experiment of belief, sharing, and confidence. In early windows, synthetic things spread out more easily, multi-modal composites more often defeat detectors, and exposure down-regulates the accuracy of belief and enhances sharing intent. Ensembles are also better detectors, although they perform poorly in realistic laundering (paraphrase, compression, re-recording, cross-modal remix). The network analysis indicates bridge accounts as the major cross-platform conduits. Our suggestions include provenance-by-default, calibrated detectors, coordination wasting, and human-in-the-loop validation of consequential claims. Results can be used in platform policy, election integrity protection, and multilingual risk monitoring in adaptive adversary efforts worldwide.

Global Political ReviewVol. X(III)
International Islamic University, Islamabad (PK)
Openalex Percentile: Top 60%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.