Introducing OmniGEC: A Silver Multilingual Dataset for Grammatical Error Correction
In this paper, we introduce OmniGEC, a collection of multilingual silver-standard datasets for the task of Grammatical Error Correction (GEC), covering eleven languages: Czech, English, Estonian, German, Greek, Icelandic, Italian, Latvian, Slovene, Swedish, and Ukrainian.These datasets facilitate the development of multilingual GEC solutions and help bridge the data gap in adapting English GEC solutions to multilingual GEC.The texts in the datasets originate from three sources: Wikipedia edits for the eleven target languages, subreddits from Reddit in the eleven target languages, and the Ukrainian-only UberText 2.0 social media corpus.While Wikipedia edits were derived from human-made corrections, the Reddit and Uber-Text 2.0 data were automatically corrected with the GPT-4o-mini model.The quality of the corrections in the datasets was evaluated both automatically and manually.Finally, we finetune two open-source large language models -Aya-Expanse (8B) and Gemma-3 (12B) -on the multilingual OmniGEC corpora and achieve state-of-the-art (SOTA) results for paragraphlevel multilingual GEC.The dataset collection and the best-performing models are available on Hugging Face 1 .
Authors
- Roman Kovalchuk (ORCID: https://orcid.org/0000-0001-8337-8591)
- Mariana Romanyshyn
- Petro Ivaniuk
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.unlp-1.17
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00