Myanmar Spelling Checking and Correction Based On Noisy Channel Model

Spelling correction is a crucial task in natural language processing, enabling improved understanding and processing of text by correcting phonetic errors, context errors and typographical errors. This paper uses Noisy Channel Model that provides the probabilistic framework for spelling correction by treating the process of typing as a transmission over a noisy channel, where the intended word is distorted. According to the Bayesian inferences, this model consists of two main components: the language model, which captures the prior probability of word sequences, and the error model, which estimates the probability of spelling errors given the intended word. The data are extracted from UCSY Monolingual Corpus. The Spell-error Corpus is manually created for training the error model. The language model is trained using the Spelling Correction Corpus, which is manually segmented and corrected from the UCSY Monolingual Corpus. Damerau-Levenshtein Distance Algorithm is used for candidates generation. Experimental findings indicate that the spelling correction method effectively addresses each type of error, achieving an overall accuracy exceeding 86% across all error categories.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/icait65209.2024.10754948
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Myanmar Spelling Checking and Correction Based On Noisy Channel Model

Win Lelt Lelt Phyu, Saung Pwint Phyu
Handwritten Text Recognition Techniques
article

Myanmar Spelling Checking and Correction Based On Noisy Channel Model

Win Lelt Lelt Phyu, Saung Pwint Phyu
article en

Abstract

Spelling correction is a crucial task in natural language processing, enabling improved understanding and processing of text by correcting phonetic errors, context errors and typographical errors. This paper uses Noisy Channel Model that provides the probabilistic framework for spelling correction by treating the process of typing as a transmission over a noisy channel, where the intended word is distorted. According to the Bayesian inferences, this model consists of two main components: the language model, which captures the prior probability of word sequences, and the error model, which estimates the probability of spelling errors given the intended word. The data are extracted from UCSY Monolingual Corpus. The Spell-error Corpus is manually created for training the error model. The language model is trained using the Spelling Correction Corpus, which is manually segmented and corrected from the UCSY Monolingual Corpus. Damerau-Levenshtein Distance Algorithm is used for candidates generation. Experimental findings indicate that the spelling correction method effectively addresses each type of error, achieving an overall accuracy exceeding 86% across all error categories.

University of Computer Studies Yangon (MM)
Quality Education
Openalex Percentile: Top 79%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.