How do LLMs’ Preferences Affect Event Argument Extraction? CAT: Addressing Preference Traps in Unsupervised EAE

Large Language Models (LLMs) have significantly improved the performance of unsupervised Event Argument Extraction (EAE) tasks.However, the prevalent preferences in LLMs severely hinder their effectiveness in EAE, leading to what we term preference traps, namely, the prior knowledge trap, the sycophancy hallucination trap, and the output contradiction trap.Existing methods often fall into these traps due to low-quality prior knowledge, ambiguous instructions, and contradictory outputs.To address this issue, we propose Choose-After-Think (CAT), an unsupervised EAE framework based on LLMs.CAT divides the task into two stages: identification of event information (think stage) and selection of arguments from a candidate argument set for template filling (choose stage).Both stages employ countermeasures to address these preference traps, while the choose stage's completely constrained outputs satisfy EAE's structured-output requirements.Experimental results demonstrate that CAT (based on the local 7B model, zero-shot setting) matches the performance of the best DeepSeek-R1 APIaccessible model, with a significantly lower time cost.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.1000
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How do LLMs’ Preferences Affect Event Argument Extraction? CAT: Addressing Preference Traps in Unsupervised EAE

Kai Shuang, Zhiyi Li, Chenrui Mao, Yunhao Wei
1 links
Natural Language Processing Techniques
article

How do LLMs’ Preferences Affect Event Argument Extraction? CAT: Addressing Preference Traps in Unsupervised EAE

Kai Shuang, Zhiyi Li, Chenrui Mao, Yunhao Wei
article en

Abstract

Large Language Models (LLMs) have significantly improved the performance of unsupervised Event Argument Extraction (EAE) tasks.However, the prevalent preferences in LLMs severely hinder their effectiveness in EAE, leading to what we term preference traps, namely, the prior knowledge trap, the sycophancy hallucination trap, and the output contradiction trap.Existing methods often fall into these traps due to low-quality prior knowledge, ambiguous instructions, and contradictory outputs.To address this issue, we propose Choose-After-Think (CAT), an unsupervised EAE framework based on LLMs.CAT divides the task into two stages: identification of event information (think stage) and selection of arguments from a candidate argument set for template filling (choose stage).Both stages employ countermeasures to address these preference traps, while the choose stage's completely constrained outputs satisfy EAE's structured-output requirements.Experimental results demonstrate that CAT (based on the local 7B model, zero-shot setting) matches the performance of the best DeepSeek-R1 APIaccessible model, with a significantly lower time cost.

Beijing University of Posts and Telecommunications (CN)
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

How do LLMs’ Preferences Affect Event Argument Extraction? CAT: Addressing Preference Traps in Unsupervised EAE — Kai Shuang, Zhiyi Li, et al. · (2025) | TGRS Research Map | TGRS