Automatic grammatical tagger for a Spanish–Mixtec parallel corpus
In this work, we developed the first intelligent automatic grammatical tagger for a Spanish–Mixtec parallel corpus in Mexico. The proposed tagger consists of multiple phases. We started by collecting a Spanish–Mixtec parallel corpus of 12,300 sentences. Then, we tokenized the corpus at the word level, removing empty lines, duplicate sentences, and empty terms from the texts, followed by identifying word units, such as multiword and compound words, and defined word classes, specifying mandatory, recommended, and optional characteristics according to the EAGLES group. We established a standard for annotating words based on EAGLES, considering three elements: attribute, value, and code. Finally, we proposed a synthetic Mixtec tag using GPT-4, GPT-4o, and a manual tag using alignment, conditional random fields (CRF) and BERT models. We manually annotated 600 sentences for a total of 2800 words and semi-automatically annotated 3000 more sentences using GPT-4o with few-shot prompting. We trained multiple models for automatic grammatical tagging, achieving a precision of 0.74 and a recall of 0.80.
Authors
- Noé Alejandro Castro-Sánchez (ORCID: https://orcid.org/0000-0002-8083-3891)
- Hermilo Santiago-Benito (ORCID: https://orcid.org/0000-0001-5650-1240)
- Diana‐Margarita Córdova‐Esparza (ORCID: https://orcid.org/0000-0002-5657-7752)
- Juan Terven (ORCID: https://orcid.org/0000-0001-6662-0390)
- Julio-Alejandro Romero-González (ORCID: https://orcid.org/0000-0001-7257-7595)
- Teresa Garcia-Ramírez
Institutions
- Autonomous University of Queretaro (MX)
- Centro Nacional de Investigación y Desarrollo Tecnológico (MX)
- Polytechnic University of Queretaro (MX)
- Instituto Politécnico Nacional (MX)
Publication Details
- Journal
- SoftwareX
- Published
- 2024-11-29
- DOI
- https://doi.org/10.1016/j.softx.2024.101985
- Citations
- 2
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.69
Funders
- Instituto Politécnico Nacional
- Secretaría de Investigación y Posgrado, Instituto Politécnico Nacional