Framing the Language: Fine-Tuning Gemma 3 for Manipulation Detection

In this paper, we present our solutions for the two UNLP 2025 shared tasks: manipulation span detection and manipulation technique classification in Ukraine-related media content sourced from Telegram channels.We experimented with fine-tuning large language models (LLMs) with up to 12 billion parameters, including both encoder-and decoderbased architectures.Our experiments identified Gemma 3 12b with a custom classification head as the best-performing model for both tasks.To address the limited size of the original training dataset, we generated 50k synthetic samples and marked up an additional 400k media entries containing manipulative content.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.unlp-1.6
Primary Topic
Computability, Logic, AI Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Framing the Language: Fine-Tuning Gemma 3 for Manipulation Detection

Anton Polishko, Yevhen Kostiuk, Artur Kiulian, Mykola Khandoga et al.
Computability, Logic, AI Algorithms
article

Framing the Language: Fine-Tuning Gemma 3 for Manipulation Detection

Anton Polishko, Yevhen Kostiuk, Artur Kiulian, Mykola Khandoga, Kostiantyn Kozlov, Yurii Filipchuk
article en

Abstract

In this paper, we present our solutions for the two UNLP 2025 shared tasks: manipulation span detection and manipulation technique classification in Ukraine-related media content sourced from Telegram channels.We experimented with fine-tuning large language models (LLMs) with up to 12 billion parameters, including both encoder-and decoderbased architectures.Our experiments identified Gemma 3 12b with a custom classification head as the best-performing model for both tasks.To address the limited size of the original training dataset, we generated 50k synthetic samples and marked up an additional 400k media entries containing manipulative content.

Openalex Percentile: Top 79%
Computability, Logic, AI Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.