Rule-Based Dialect of Tulang Bawang Stemmer
Stemming, an essential procedure in natural language processing (NLP), diminishes words to their base forms, facilitating tasks such as information retrieval and sentiment analysis. Although stemming techniques for highresource languages are well-developed, numerous low-resource languages, including dialect of Tulang Bawang, suffer from inadequate solutions owing to a scarcity of linguistic data and resources. Existing systems, including rule-based stemmers, have demonstrated efficacy in processing low-resource languages such as Indonesian and Javanese by utilizing established morphological rules. Nonetheless, these methods encounter considerable obstacles, such as restricted adaptability, inability to accommodate unusual root structures, and excessive dependence on fixed rules that might result in over- or understemming. Rule-based methodologies frequently misidentify roots when faced with intricate affixes or unconventional word forms. We introduce an improved rule-based Tulang Bawang Stemmer aimed at overcoming these constraints by enhancing current linguistic rules and integrating new patterns specific to the language's morphology. Assessed on 500 test samples and 200 independent test samples, our improved stemmer attained gold standard evaluation metrics of 96.2% and 94%, respectively, surpassing prior implementations in both precision and generalization. The findings demonstrate the potential of enhanced rule-based techniques to improving NLP for lowresource languages. Improved stemming performance enables better downstream applications, promotes more efficient text analysis, and advances research in underrepresented languages.
Authors
- Zaenal Abidin (ORCID: https://orcid.org/0000-0003-4237-7167)
- Akmal Junaidi (ORCID: https://orcid.org/0000-0003-1030-6954)
- Dian Kurniasari (ORCID: https://orcid.org/0000-0001-8488-8112)
- Rohmat Indra Borman (ORCID: https://orcid.org/0000-0003-0914-3932)
- Favorisen Rosyking Lumbanraja (ORCID: https://orcid.org/0000-0002-1790-831X)
- Wamiliana Wamiliana
Institutions
- Lampung University (ID)
- Universitas Teknokrat Indonesia (ID)
- Universitas Bandar Lampung (ID)
Publication Details
- Published
- 2025-02-03
- DOI
- https://doi.org/10.1109/icadeis65852.2025.10933405
- Citations
- 3
- Primary Topic
- Linguistic Variation and Morphology
- Type
- article
- Field-Weighted Citation Impact
- 18.39