They want to pretend not to understand: The Limits of Current LLMs in Interpreting Implicit Content of Political Discourse

Implicit content plays a crucial role in political discourse, where speakers systematically employ pragmatic strategies such as implicatures and presuppositions to influence their audiences.Large Language Models (LLMs) have demonstrated strong performance in tasks requiring complex semantic and pragmatic understanding, highlighting their potential for detecting and explaining the meaning of implicit content.However, their ability to do this within political discourse remains largely underexplored.Leveraging, for the first time, the large IMPAQTS corpus, which comprises Italian political speeches with the annotation of manipulative implicit content, we propose methods to test the effectiveness of LLMs in this challenging problem.Through a multiplechoice task and an open-ended generation task, we demonstrate that all tested models struggle to interpret presuppositions and implicatures.We conclude that current LLMs lack the key pragmatic capabilities necessary for accurately interpreting highly implicit language, such as that found in political discourse.At the same time, we highlight promising trends and future directions for enhancing model performance.We release our data and code at:

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.804
Primary Topic
Legal Language and Interpretation
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

They want to pretend not to understand: The Limits of Current LLMs in Interpreting Implicit Content of Political Discourse

Sandro Pezzelle, Alessandro Panunzi, Walter Paci
Legal Language and Interpretation
article

They want to pretend not to understand: The Limits of Current LLMs in Interpreting Implicit Content of Political Discourse

Sandro Pezzelle, Alessandro Panunzi, Walter Paci
article en

Abstract

Implicit content plays a crucial role in political discourse, where speakers systematically employ pragmatic strategies such as implicatures and presuppositions to influence their audiences.Large Language Models (LLMs) have demonstrated strong performance in tasks requiring complex semantic and pragmatic understanding, highlighting their potential for detecting and explaining the meaning of implicit content.However, their ability to do this within political discourse remains largely underexplored.Leveraging, for the first time, the large IMPAQTS corpus, which comprises Italian political speeches with the annotation of manipulative implicit content, we propose methods to test the effectiveness of LLMs in this challenging problem.Through a multiplechoice task and an open-ended generation task, we demonstrate that all tested models struggle to interpret presuppositions and implicatures.We conclude that current LLMs lack the key pragmatic capabilities necessary for accurately interpreting highly implicit language, such as that found in political discourse.At the same time, we highlight promising trends and future directions for enhancing model performance.We release our data and code at:

University of Florence (IT)
Universiteit van Amsterdam, Università degli Studi di Firenze
Openalex Percentile: Top 69%
Legal Language and Interpretation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.