gec-metrics: A Unified Library for Grammatical Error Correction Evaluation

We introduce GEC-METRICS, a library for using and developing grammatical error correction (GEC) evaluation metrics through a unified interface.Our library enables fair system comparisons by ensuring that everyone conducts evaluations using a consistent implementation.Moreover, it is designed with a strong focus on API usage, making it highly extensible.It also includes meta-evaluation functionalities and provides analysis and visualization scripts, contributing to developing GEC evaluation metrics.Our code is released under the MIT license 1 and is also distributed as an installable package 2 .The video is available on YouTube 3 .

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-demo.50
Citations
2
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

gec-metrics: A Unified Library for Grammatical Error Correction Evaluation

Yusuke Sakai, Taro Watanabe, Takumi Goto
2 citations
Natural Language Processing Techniques
4.96
article

gec-metrics: A Unified Library for Grammatical Error Correction Evaluation

Yusuke Sakai, Taro Watanabe, Takumi Goto
article en
2 citations

Abstract

We introduce GEC-METRICS, a library for using and developing grammatical error correction (GEC) evaluation metrics through a unified interface.Our library enables fair system comparisons by ensuring that everyone conducts evaluations using a consistent implementation.Moreover, it is designed with a strong focus on API usage, making it highly extensible.It also includes meta-evaluation functionalities and provides analysis and visualization scripts, contributing to developing GEC evaluation metrics.Our code is released under the MIT license 1 and is also distributed as an installable package 2 .The video is available on YouTube 3 .

Nara Institute of Science and Technology (JP)
Quality Education
Openalex Percentile: Top 5%
Natural Language Processing Techniques
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.