Auditing Election-Disinformation Compliance in Open-Weight LLMs Across African and Western Contexts

This study tests how often open-weight AI models agree to write false election information such as a wrong voting date when asked. We tested 220 prompts across four elections: South Africa, Kenya, the UK, and the US (Pennsylvania). Models complied about 97% of the time with no safety measures. A short safety instruction (Constitution) reduced this to about 12%, but also made models refuse some genuine election questions. Code, prompt templates (with false claims replaced by placeholders), judgement labels, and results are included. Raw model outputs and filled-in false claims are withheld to prevent misuse.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-28
DOI
https://doi.org/10.5281/zenodo.20997083
Primary Topic
Misinformation and Its Impacts
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Auditing Election-Disinformation Compliance in Open-Weight LLMs Across African and Western Contexts

A Gupta, Karan Singh, Joshua David Padoa
Zenodo (CERN European Organization for Nuclear Research)
Misinformation and Its Impacts
preprint

Auditing Election-Disinformation Compliance in Open-Weight LLMs Across African and Western Contexts

A Gupta, Karan Singh, Joshua David Padoa
preprint en

Abstract

This study tests how often open-weight AI models agree to write false election information such as a wrong voting date when asked. We tested 220 prompts across four elections: South Africa, Kenya, the UK, and the US (Pennsylvania). Models complied about 97% of the time with no safety measures. A short safety instruction (Constitution) reduced this to about 12%, but also made models refuse some genuine election questions. Code, prompt templates (with false claims replaced by placeholders), judgement labels, and results are included. Raw model outputs and filled-in false claims are withheld to prevent misuse.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.