Framing the Language: Fine-Tuning Gemma 3 for Manipulation Detection
In this paper, we present our solutions for the two UNLP 2025 shared tasks: manipulation span detection and manipulation technique classification in Ukraine-related media content sourced from Telegram channels.We experimented with fine-tuning large language models (LLMs) with up to 12 billion parameters, including both encoder-and decoderbased architectures.Our experiments identified Gemma 3 12b with a custom classification head as the best-performing model for both tasks.To address the limited size of the original training dataset, we generated 50k synthetic samples and marked up an additional 400k media entries containing manipulative content.
Authors
- Anton Polishko
- Yevhen Kostiuk (ORCID: https://orcid.org/0000-0002-8104-5141)
- Artur Kiulian
- Mykola Khandoga
- Kostiantyn Kozlov
- Yurii Filipchuk
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.unlp-1.6
- Primary Topic
- Computability, Logic, AI Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00