Enhancing grammatical documentation for endangered languages with graph-based meaning representation and Loopy Belief Propagation

DIG4EL (Digital Inferential Grammars for Endangered Languages) is a method embodied in software designed to assist linguists and teachers in producing grammatical descriptions for endangered languages. DIG4EL integrates linguistic knowledge from extensive databases such as WALS and Grambank with automated observations of controlled data collected using Conversational Questionnaires. Linguistic knowledge and automated observations provide priors to a Bayesian network of grammatical parameters, where parameters are interconnected by directional conditional probability matrices derived from statistics on world languages. Inference of unknown parameter values is performed using Loopy Belief Propagation, achieving an average accuracy of 76% and a median accuracy of 85% in an experimental grammatical domain, determining the values of eight parameters related to canonical word order across 116 languages from diverse language families. DIG4EL produces outputs either as structured files for computational use, Microsoft Word files, or plain-language grammatical descriptions generated by a Large Language Model. These descriptions rely solely on vetted data and observed examples, with prompts crafted explicitly to prevent external information or hallucinations. By leveraging probabilistic modeling and rich, yet quickly assembled linguistic data, DIG4EL provides a powerful, accessible tool for creating grammatical descriptions and language teaching materials with minimal intervention from linguists. It significantly reduces the time and expertise required for traditional documentation workflows, ensuring endangered languages are better documented and taught. • Bayesian networks enable grammatical inference for endangered languages using as few as 200 controlled sentences. • A graph-based semantic representation supports the extraction of detailed grammatical structures. • Loopy Belief Propagation infers the value of unknown grammatical parameters with a median accuracy of 85%. • The DIG4EL software produces both structured JSON outputs and accessible, plain-language grammatical descriptions.

Authors

Institutions

Publication Details

Journal
Natural Language Processing Journal
Published
2025-06-18
DOI
https://doi.org/10.1016/j.nlp.2025.100164
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing grammatical documentation for endangered languages with graph-based meaning representation and Loopy Belief Propagation

Shyaka Alain Christian
Natural Language Processing Journal
Natural Language Processing Techniques
article

Enhancing grammatical documentation for endangered languages with graph-based meaning representation and Loopy Belief Propagation

Shyaka Alain Christian
article en

Abstract

DIG4EL (Digital Inferential Grammars for Endangered Languages) is a method embodied in software designed to assist linguists and teachers in producing grammatical descriptions for endangered languages. DIG4EL integrates linguistic knowledge from extensive databases such as WALS and Grambank with automated observations of controlled data collected using Conversational Questionnaires. Linguistic knowledge and automated observations provide priors to a Bayesian network of grammatical parameters, where parameters are interconnected by directional conditional probability matrices derived from statistics on world languages. Inference of unknown parameter values is performed using Loopy Belief Propagation, achieving an average accuracy of 76% and a median accuracy of 85% in an experimental grammatical domain, determining the values of eight parameters related to canonical word order across 116 languages from diverse language families. DIG4EL produces outputs either as structured files for computational use, Microsoft Word files, or plain-language grammatical descriptions generated by a Large Language Model. These descriptions rely solely on vetted data and observed examples, with prompts crafted explicitly to prevent external information or hallucinations. By leveraging probabilistic modeling and rich, yet quickly assembled linguistic data, DIG4EL provides a powerful, accessible tool for creating grammatical descriptions and language teaching materials with minimal intervention from linguists. It significantly reduces the time and expertise required for traditional documentation workflows, ensuring endangered languages are better documented and taught. • Bayesian networks enable grammatical inference for endangered languages using as few as 200 controlled sentences. • A graph-based semantic representation supports the extraction of detailed grammatical structures. • Loopy Belief Propagation infers the value of unknown grammatical parameters with a median accuracy of 85%. • The DIG4EL software produces both structured JSON outputs and accessible, plain-language grammatical descriptions.

Natural Language Processing JournalVol. 12
University of French Polynesia (PF)
Centre National de la Recherche Scientifique
Quality Education
Openalex Percentile: Top 93%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.