Automatic grammatical tagger for a Spanish–Mixtec parallel corpus

In this work, we developed the first intelligent automatic grammatical tagger for a Spanish–Mixtec parallel corpus in Mexico. The proposed tagger consists of multiple phases. We started by collecting a Spanish–Mixtec parallel corpus of 12,300 sentences. Then, we tokenized the corpus at the word level, removing empty lines, duplicate sentences, and empty terms from the texts, followed by identifying word units, such as multiword and compound words, and defined word classes, specifying mandatory, recommended, and optional characteristics according to the EAGLES group. We established a standard for annotating words based on EAGLES, considering three elements: attribute, value, and code. Finally, we proposed a synthetic Mixtec tag using GPT-4, GPT-4o, and a manual tag using alignment, conditional random fields (CRF) and BERT models. We manually annotated 600 sentences for a total of 2800 words and semi-automatically annotated 3000 more sentences using GPT-4o with few-shot prompting. We trained multiple models for automatic grammatical tagging, achieving a precision of 0.74 and a recall of 0.80.

Authors

Institutions

Publication Details

Journal
SoftwareX
Published
2024-11-29
DOI
https://doi.org/10.1016/j.softx.2024.101985
Citations
2
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatic grammatical tagger for a Spanish–Mixtec parallel corpus

Noé Alejandro Castro-Sánchez, Hermilo Santiago-Benito, Diana‐Margarita Córdova‐Esparza, Juan Terven et al.
2 citations
SoftwareX
Natural Language Processing Techniques
0.69
article

Automatic grammatical tagger for a Spanish–Mixtec parallel corpus

Noé Alejandro Castro-Sánchez, Hermilo Santiago-Benito, Diana‐Margarita Córdova‐Esparza, Juan Terven, Julio-Alejandro Romero-González, Teresa Garcia-Ramírez
article en
2 citations

Abstract

In this work, we developed the first intelligent automatic grammatical tagger for a Spanish–Mixtec parallel corpus in Mexico. The proposed tagger consists of multiple phases. We started by collecting a Spanish–Mixtec parallel corpus of 12,300 sentences. Then, we tokenized the corpus at the word level, removing empty lines, duplicate sentences, and empty terms from the texts, followed by identifying word units, such as multiword and compound words, and defined word classes, specifying mandatory, recommended, and optional characteristics according to the EAGLES group. We established a standard for annotating words based on EAGLES, considering three elements: attribute, value, and code. Finally, we proposed a synthetic Mixtec tag using GPT-4, GPT-4o, and a manual tag using alignment, conditional random fields (CRF) and BERT models. We manually annotated 600 sentences for a total of 2800 words and semi-automatically annotated 3000 more sentences using GPT-4o with few-shot prompting. We trained multiple models for automatic grammatical tagging, achieving a precision of 0.74 and a recall of 0.80.

SoftwareXVol. 29
Autonomous University of Queretaro (MX), Centro Nacional de Investigación y Desarrollo Tecnológico (MX), Polytechnic University of Queretaro (MX), Instituto Politécnico Nacional (MX)
Instituto Politécnico Nacional, Secretaría de Investigación y Posgrado, Instituto Politécnico Nacional
Openalex Percentile: Top 23%
Natural Language Processing Techniques
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.