gec-metrics: A Unified Library for Grammatical Error Correction Evaluation
We introduce GEC-METRICS, a library for using and developing grammatical error correction (GEC) evaluation metrics through a unified interface.Our library enables fair system comparisons by ensuring that everyone conducts evaluations using a consistent implementation.Moreover, it is designed with a strong focus on API usage, making it highly extensible.It also includes meta-evaluation functionalities and provides analysis and visualization scripts, contributing to developing GEC evaluation metrics.Our code is released under the MIT license 1 and is also distributed as an installable package 2 .The video is available on YouTube 3 .
Authors
- Yusuke Sakai (ORCID: https://orcid.org/0000-0001-8810-4813)
- Taro Watanabe
- Takumi Goto
Institutions
- Nara Institute of Science and Technology (JP)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-demo.50
- Citations
- 2
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 4.96