LORuGEC: the Linguistically Oriented Rule-annotated corpus for Grammatical Error Correction of Russian

We release LORuGEC -the first rule-annotated corpus for Russian grammatical error correction.The sentences in it are accompanied with the grammar rules governing their spelling.In total, we collected 48 rules with 348 sentences for validation and 612 for testing.LORuGEC appears to be challenging for open-source LLMs: the best F0.5-score is achieved by Qwen2.5-7B using two-stage finetuning and is only 50%.The closed YandexGPT4 Pro model achieves the score of 75%.Using a rule-informed retriever for fewshot example selection, we improve these scores up to 57% for Qwen and 81% for YandexGPT4 Pro.