PAN-KK:A Language Resource for Plagiarism Detection in Low-Resource Kazakh

We present PAN-KK, to our knowledge, the first dataset created specifically for extrinsic plagiarism detection in Kazakh. PAN-KK is derived by translating over 20,000 English PAN 2010 plagiarism pairs and includes a human-validated subset in which 2,000 samples were reviewed by 10 native Kazakh speakers. Using PAN-KK, we train and evaluate several transformer-based models; XLM-RoBERTa Large achieves the best performance. To demonstrate practical use, we integrate the model into a two-stage detection pipeline: (i) candidate retrieval and (ii) neural verification with span-level localisation. On a manually annotated set of 1,000 Kazakh text pairs, token-based evaluation yields P=0.929, R=0.843, and F1=0.868, while span-level localisation attains P=0.718, R=0.649, and F1=0.667. PAN-KK and the accompanying pipeline provide an important starting point for improving plagiarism detection in low-resource languages such as Kazakh.

Publication Details

Journal
University of Birmingham Research Portal (University of Birmingham)
Published
2025-11-10
Primary Topic
Academic integrity and plagiarism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PAN-KK:A Language Resource for Plagiarism Detection in Low-Resource Kazakh

University of Birmingham Research Portal (University of Birmingham)
Academic integrity and plagiarism
article

PAN-KK:A Language Resource for Plagiarism Detection in Low-Resource Kazakh

article en

Abstract

We present PAN-KK, to our knowledge, the first dataset created specifically for extrinsic plagiarism detection in Kazakh. PAN-KK is derived by translating over 20,000 English PAN 2010 plagiarism pairs and includes a human-validated subset in which 2,000 samples were reviewed by 10 native Kazakh speakers. Using PAN-KK, we train and evaluate several transformer-based models; XLM-RoBERTa Large achieves the best performance. To demonstrate practical use, we integrate the model into a two-stage detection pipeline: (i) candidate retrieval and (ii) neural verification with span-level localisation. On a manually annotated set of 1,000 Kazakh text pairs, token-based evaluation yields P=0.929, R=0.843, and F1=0.868, while span-level localisation attains P=0.718, R=0.649, and F1=0.667. PAN-KK and the accompanying pipeline provide an important starting point for improving plagiarism detection in low-resource languages such as Kazakh.

University of Birmingham Research Portal (University of Birmingham)
Openalex Percentile: Top 33%
Academic integrity and plagiarism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.