Annotation Guidelines for LLM-Generated PRCT Classifications: Protocol for Human Auditing in Parliamentary Debates, Manifestos, and Web Archives

This document establishes the formal validation protocol used by human experts to audit and verify zero-shot Large Language Model (DeepSeek-v3) predictions concerning Population Replacement Conspiracy Theories (PRCT). Unlike traditional ab initio annotation frameworks, this protocol outlines a model-in-the-loop auditing workflow where human operators assign a binary decision (CONFIRM/REJECT) to the LLM's classification across long-form textual archives. The guidelines provide specific diagnostic criteria to police the boundary between generic anti-immigration rhetoric and structured conspiratorial frameworks within three distinct communicative domains:1. Parliamentary Debates (Institutional Register and Rhetorical Maquillage)2. Political Manifestos (Programmatic and Party Registers)3. Web Archives (Digital Fringe Registers) This methodological documentation ensures the reproducibility of the gold standard used to evaluate psycholinguistic and stylistic variation in radical political discourse within the framework of the HYBRIDS project.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-18
DOI
https://doi.org/10.5281/zenodo.20271849
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Annotation Guidelines for LLM-Generated PRCT Classifications: Protocol for Human Auditing in Parliamentary Debates, Manifestos, and Web Archives

Erik Bran Marino
Zenodo (CERN European Organization for Nuclear Research)
Misinformation and Its Impacts
article

Annotation Guidelines for LLM-Generated PRCT Classifications: Protocol for Human Auditing in Parliamentary Debates, Manifestos, and Web Archives

Erik Bran Marino
article en

Abstract

This document establishes the formal validation protocol used by human experts to audit and verify zero-shot Large Language Model (DeepSeek-v3) predictions concerning Population Replacement Conspiracy Theories (PRCT). Unlike traditional ab initio annotation frameworks, this protocol outlines a model-in-the-loop auditing workflow where human operators assign a binary decision (CONFIRM/REJECT) to the LLM's classification across long-form textual archives. The guidelines provide specific diagnostic criteria to police the boundary between generic anti-immigration rhetoric and structured conspiratorial frameworks within three distinct communicative domains:1. Parliamentary Debates (Institutional Register and Rhetorical Maquillage)2. Political Manifestos (Programmatic and Party Registers)3. Web Archives (Digital Fringe Registers) This methodological documentation ensures the reproducibility of the gold standard used to evaluate psycholinguistic and stylistic variation in radical political discourse within the framework of the HYBRIDS project.

Zenodo (CERN European Organization for Nuclear Research)
Secretaria Municipal de Cultura (BR)
Openalex Percentile: Top 3%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.