Can Large Language Models Address Open-Target Stance Detection?

Stance detection (SD) identifies a text's position towards a target, typically labeled as favor, against, or none.We introduce Open-Target Stance Detection (OTSD), the most realistic task where targets are neither seen during training nor provided as input.We evaluate Large Language Models (LLMs) from GPT, Gemini, Llama, and Mistral families, comparing their performance to the only existing work, Target-Stance Extraction (TSE), which benefits from predefined targets.Unlike TSE, OTSD removes the dependency of a predefined list, making target generation and evaluation more challenging.We also provide a metric for evaluating target quality that correlates well with human judgment.Our experiments reveal that LLMs outperform TSE in target generation, both when the real target is explicitly and not explicitly mentioned in the text.Similarly, LLMs overall surpass TSE in stance detection for both explicit and non-explicit cases.However, LLMs struggle in both target generation and stance detection when the target is not explicit. 1

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.54
Citations
2
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
4.96

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can Large Language Models Address Open-Target Stance Detection?

Abu Ubaida Akash, Amine Trabelsi, Ahmed Fahmy
2 citations
Topic Modeling
4.96
article

Can Large Language Models Address Open-Target Stance Detection?

Abu Ubaida Akash, Amine Trabelsi, Ahmed Fahmy
article en
2 citations

Abstract

Stance detection (SD) identifies a text's position towards a target, typically labeled as favor, against, or none.We introduce Open-Target Stance Detection (OTSD), the most realistic task where targets are neither seen during training nor provided as input.We evaluate Large Language Models (LLMs) from GPT, Gemini, Llama, and Mistral families, comparing their performance to the only existing work, Target-Stance Extraction (TSE), which benefits from predefined targets.Unlike TSE, OTSD removes the dependency of a predefined list, making target generation and evaluation more challenging.We also provide a metric for evaluating target quality that correlates well with human judgment.Our experiments reveal that LLMs outperform TSE in target generation, both when the real target is explicitly and not explicitly mentioned in the text.Similarly, LLMs overall surpass TSE in stance detection for both explicit and non-explicit cases.However, LLMs struggle in both target generation and stance detection when the target is not explicit. 1

Université de Sherbrooke (CA)
Alliance de recherche numérique du Canada, Natural Sciences and Engineering Research Council of Canada
Openalex Percentile: Top 5%
Topic Modeling
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Can Large Language Models Address Open-Target Stance Detection? — Abu Ubaida Akash, Amine Trabelsi, et al. · (2025) | TGRS Research Map | TGRS