Enhancing grammatical documentation for endangered languages with graph-based meaning representation and Loopy Belief Propagation
DIG4EL (Digital Inferential Grammars for Endangered Languages) is a method embodied in software designed to assist linguists and teachers in producing grammatical descriptions for endangered languages. DIG4EL integrates linguistic knowledge from extensive databases such as WALS and Grambank with automated observations of controlled data collected using Conversational Questionnaires. Linguistic knowledge and automated observations provide priors to a Bayesian network of grammatical parameters, where parameters are interconnected by directional conditional probability matrices derived from statistics on world languages. Inference of unknown parameter values is performed using Loopy Belief Propagation, achieving an average accuracy of 76% and a median accuracy of 85% in an experimental grammatical domain, determining the values of eight parameters related to canonical word order across 116 languages from diverse language families. DIG4EL produces outputs either as structured files for computational use, Microsoft Word files, or plain-language grammatical descriptions generated by a Large Language Model. These descriptions rely solely on vetted data and observed examples, with prompts crafted explicitly to prevent external information or hallucinations. By leveraging probabilistic modeling and rich, yet quickly assembled linguistic data, DIG4EL provides a powerful, accessible tool for creating grammatical descriptions and language teaching materials with minimal intervention from linguists. It significantly reduces the time and expertise required for traditional documentation workflows, ensuring endangered languages are better documented and taught. • Bayesian networks enable grammatical inference for endangered languages using as few as 200 controlled sentences. • A graph-based semantic representation supports the extraction of detailed grammatical structures. • Loopy Belief Propagation infers the value of unknown grammatical parameters with a median accuracy of 85%. • The DIG4EL software produces both structured JSON outputs and accessible, plain-language grammatical descriptions.
Authors
- Shyaka Alain Christian (ORCID: https://orcid.org/0009-0009-2785-5432)
Institutions
- University of French Polynesia (PF)
Publication Details
- Journal
- Natural Language Processing Journal
- Published
- 2025-06-18
- DOI
- https://doi.org/10.1016/j.nlp.2025.100164
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Centre National de la Recherche Scientifique