The levers of political persuasion with conversational artificial intelligence
There are widespread fears that conversational artificial intelligence (AI) could soon exert unprecedented influence over human beliefs. In this work, in three large-scale experiments (<i>N</i> = 76,977 participants), we deployed 19 large language models (LLMs)-including some post-trained explicitly for persuasion-to evaluate their persuasiveness on 707 political issues. We then checked the factual accuracy of 466,769 resulting LLM claims. We show that the persuasive power of current and near-future AI is likely to stem more from post-training and prompting methods-which boosted persuasiveness by as much as 51 and 27%, respectively-than from personalization or increasing model scale, which had smaller effects. We further show that these methods increased persuasion by exploiting LLMs' ability to rapidly access and strategically deploy information and that, notably, where they increased AI persuasiveness, they also systematically decreased factual accuracy.
Authors
- Ben M Tappin (ORCID: https://orcid.org/0000-0002-3826-8016)
- Hause Lin (ORCID: https://orcid.org/0000-0003-4590-7039)
- Christopher Summerfield (ORCID: https://orcid.org/0000-0002-2941-2653)
- Helen Margetts (ORCID: https://orcid.org/0000-0003-4597-8283)
- Luke Hewitt (ORCID: https://orcid.org/0000-0001-8278-7692)
- David G. Rand (ORCID: https://orcid.org/0000-0001-8975-2783)
- Kobi Hackenburg (ORCID: https://orcid.org/0000-0003-2071-1726)
- E. Dale Saunders (ORCID: https://orcid.org/0009-0002-3865-8409)
- Stewart Black (ORCID: https://orcid.org/0009-0008-3910-804X)
- Catherine Fist
Institutions
- Cornell University (US)
- University of Oxford (GB)
- New York State College of Agriculture & Life Sciences (US)
- Research Institute in Science of Cyber Security (GB)
- Massachusetts Institute of Technology (US)
- London School of Economics and Political Science (GB)
- Stanford University (US)
Publication Details
- Journal
- Science
- Published
- 2025-12-04
- DOI
- https://doi.org/10.1126/science.aea3884
- Citations
- 10
- Primary Topic
- Misinformation and Its Impacts
- Type
- article
- Field-Weighted Citation Impact
- 42.02
Funders
- Government of the United Kingdom
- UK Research and Innovation
- Leverhulme Trust
- University of Bristol
- Science and Technology Facilities Council