EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation

Misinformation is a global issue that shapes public discourse, influencing opinions and decision-making across various domains.While automated fact-checking (AFC) has become essential in combating misinformation, most work in multilingual settings has focused on claim verification rather than generating explanatory verdicts (i.e.short texts discussing the veracity of the claim), leaving a gap in AFC resources beyond English.To this end, we introduce EuroVerdict, a multilingual dataset designed for verdict generation, covering eight European languages.Developed in collaboration with professional factcheckers, the dataset comprises claims, manually written verdicts, and supporting evidence, including fact-checking articles and additional secondary sources.We evaluate EuroVerdict with Llama-3.1-8B-Instruct on verdict generation under different settings, varying the prompt language, input article language, and training approach.Our results show that fine-tuning consistently improves performance, with models fine-tuned on original-language articles achieving the highest scores in both automatic and human evaluations.Using articles in a different language from the claim slightly lowers performance; however, pairing them with language-specific prompts improves results.Zero-shot and Chain-of-Thought setups perform worse, reinforcing the benefits of fine-tuning for multilingual verdict generation.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.853
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation

Stefano Menini, Daniel Russo, Marco Guerini, Fariba Sadeghi
Hate Speech and Cyberbullying Detection
article

EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation

Stefano Menini, Daniel Russo, Marco Guerini, Fariba Sadeghi
article en

Abstract

Misinformation is a global issue that shapes public discourse, influencing opinions and decision-making across various domains.While automated fact-checking (AFC) has become essential in combating misinformation, most work in multilingual settings has focused on claim verification rather than generating explanatory verdicts (i.e.short texts discussing the veracity of the claim), leaving a gap in AFC resources beyond English.To this end, we introduce EuroVerdict, a multilingual dataset designed for verdict generation, covering eight European languages.Developed in collaboration with professional factcheckers, the dataset comprises claims, manually written verdicts, and supporting evidence, including fact-checking articles and additional secondary sources.We evaluate EuroVerdict with Llama-3.1-8B-Instruct on verdict generation under different settings, varying the prompt language, input article language, and training approach.Our results show that fine-tuning consistently improves performance, with models fine-tuned on original-language articles achieving the highest scores in both automatic and human evaluations.Using articles in a different language from the claim slightly lowers performance; however, pairing them with language-specific prompts improves results.Zero-shot and Chain-of-Thought setups perform worse, reinforcing the benefits of fine-tuning for multilingual verdict generation.

Yale University, European Commission, HORIZON EUROPE Framework Programme
Reduced inequalities
Openalex Percentile: Top 90%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

EuroVerdict: A Multilingual Dataset for Verdict Generation Against Misinformation — Stefano Menini, Daniel Russo, et al. · (2025) | TGRS Research Map | TGRS