Lemmatising Early Modern English: An LLM-assisted experiment

In the reported experiment, our team developed an LLM-assisted procedure for the lemmatisation of the Penn-Helsinki Parsed Corpus of Early Modern English (PPCEME), and Early Modern English (EME) in general. First, we engineered a set of annotation guidelines for lemmatising word forms found in PPCEME on the basis of context and morphosyntactic tags. The lemmatisations were checked manually by a team of annotators and the overall accuracy of the procedure based on GPT-4o-mini was between 95% and 97%, with some bypasses applied. The paper presents an in-depth quantitative and qualitative analysis of the results, where the main advantages and weaknesses of the model are identified. The LLM-based procedure is also compared to VARD, a popular tool used for normalising EME spelling. Finally, we also fine-tuned a smaller specialised model aimed at lemmatising EME texts, for which we report the highest accuracy values of 96–97% on held-out evaluation datasets.

Authors

Institutions

Publication Details

Journal
International Journal of Corpus Linguistics
Published
2026-11-19
DOI
https://doi.org/10.1075/ijcl.26092.cic
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Lemmatising Early Modern English: An LLM-assisted experiment

Piotr Pęzik, Kamil Andrzejczak, Anna Cichosz, Aleksandra Stasiak et al.
International Journal of Corpus Linguistics
Natural Language Processing Techniques
article

Lemmatising Early Modern English: An LLM-assisted experiment

Piotr Pęzik, Kamil Andrzejczak, Anna Cichosz, Aleksandra Stasiak, Filip Żarnecki, Jakub Kwiatkowski, Igor Siek, Aneta Wyczechowska
article en

Abstract

In the reported experiment, our team developed an LLM-assisted procedure for the lemmatisation of the Penn-Helsinki Parsed Corpus of Early Modern English (PPCEME), and Early Modern English (EME) in general. First, we engineered a set of annotation guidelines for lemmatising word forms found in PPCEME on the basis of context and morphosyntactic tags. The lemmatisations were checked manually by a team of annotators and the overall accuracy of the procedure based on GPT-4o-mini was between 95% and 97%, with some bypasses applied. The paper presents an in-depth quantitative and qualitative analysis of the results, where the main advantages and weaknesses of the model are identified. The LLM-based procedure is also compared to VARD, a popular tool used for normalising EME spelling. Finally, we also fine-tuned a smaller specialised model aimed at lemmatising EME texts, for which we report the highest accuracy values of 96–97% on held-out evaluation datasets.

International Journal of Corpus Linguistics
University of Łódź (PL)
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon