Robust Detection of Persuasion Techniques in Slavic Languages via Multitask Debiasing and Walking Embeddings
Our approach to Subtask 1 integrates fine-tuned multilingual transformer models with two complementary robustness-oriented strategies: Walking Embeddings and Content-Debiasing.With the first, we tried to understand the change in embeddings when various manipulation techniques were applied.The latter leverages a supervised contrastive objective over semantically equivalent yet stylistically divergent text pairs, generated via GPT-4.We conduct extensive experiments, including 5-fold crossvalidation and out-of-domain evaluation, and explore the impact of contrastive loss weighting.
Authors
- Krzysztof Węcel (ORCID: https://orcid.org/0000-0001-5641-3160)
- Ewelina Księżniak (ORCID: https://orcid.org/0000-0003-1953-8014)
- Marcin Sawiński (ORCID: https://orcid.org/0000-0002-1226-4850)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.bsnlp-1.25
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00