Enhancing Paraphrase Evaluation in Marathi Question Answering Systems Using Similarity Techniques

In Natural Language Processing applications, paraphrasing is essential, especially in Question Answering (QA) systems where users may provide distinct yet valid responses to the same questions. This study presents a structured approach for evaluating paraphrased answers in the Marathi language using multiple similarity measures, including Levenshtein Distance, Jaccard Similarity, and Cosine Similarity. The proposed methodology integrates one-to-one word matching, masking techniques, synonym dictionary verification, and dependency parsing to ensure grammatical and syntactic consistency. A dataset comprising 540 questions from the Balbharti Standard 2 textbook, each with three student-generated paraphrased answers, was analyzed. The findings indicate that this approach effectively captures lexical and semantic similarities, enhancing the robustness and fairness of Marathi QA systems. By leveraging multiple similarity measures, this study establishes a systematic framework for paraphrase identification, improving automated answer evaluation.

Authors

Publication Details

Journal
Journal of Information Systems Engineering & Management
Published
2025-04-22
DOI
https://doi.org/10.52783/jisem.v10i38s.6958
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Paraphrase Evaluation in Marathi Question Answering Systems Using Similarity Techniques

Aarti P. Raut
Journal of Information Systems Engineering & Management
Topic Modeling
article

Enhancing Paraphrase Evaluation in Marathi Question Answering Systems Using Similarity Techniques

Aarti P. Raut
article en

Abstract

In Natural Language Processing applications, paraphrasing is essential, especially in Question Answering (QA) systems where users may provide distinct yet valid responses to the same questions. This study presents a structured approach for evaluating paraphrased answers in the Marathi language using multiple similarity measures, including Levenshtein Distance, Jaccard Similarity, and Cosine Similarity. The proposed methodology integrates one-to-one word matching, masking techniques, synonym dictionary verification, and dependency parsing to ensure grammatical and syntactic consistency. A dataset comprising 540 questions from the Balbharti Standard 2 textbook, each with three student-generated paraphrased answers, was analyzed. The findings indicate that this approach effectively captures lexical and semantic similarities, enhancing the robustness and fairness of Marathi QA systems. By leveraging multiple similarity measures, this study establishes a systematic framework for paraphrase identification, improving automated answer evaluation.

Journal of Information Systems Engineering & ManagementVol. 10(38s)
Dr. Babasaheb Ambedkar Research and Training Institute, Chhatrapati Shahu Maharaj Research Training and Human Development Institute
Openalex Percentile: Top 96%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.