Catalyzing Multilingual NLP: New Methods for Low-Resource Language Support

This paper talks about a new way to make queries for Large Language Models (LLMs) better. We introduce a method called Query Semantic Complexity (QSC). This method helps to understand how complicated user queries are. It is better than older ways of measuring complexity. Next, we created an algorithm called Adaptive Semantic Query Optimization (ASQO). This algorithm changes how queries are processed based on their complexity. Our method uses a special function that looks at two things: how accurate the answers are and how fast they are given. We did many tests with different LLMs, like GPT-3, T5-11B, and BERT-large. The results showed that our method improves how fast queries are processed, how accurate the answers are, and how happy users feel. We also looked at examples in areas like scientific papers and technical documents to show how our method works in real life. Our method is especially good for complicated queries and works well even when the models are bigger. This gives a good way to make query performance better in LLMs.

Authors

Institutions

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1109/ictacs62700.2024.10840816
Citations
4
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
1.39
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Catalyzing Multilingual NLP: New Methods for Low-Resource Language Support

Ayush Thakur, Gurinder Singh, Rajneesh Kler, Pranay Verma et al.
4 citations
Natural Language Processing Techniques
1.39
article

Catalyzing Multilingual NLP: New Methods for Low-Resource Language Support

Ayush Thakur, Gurinder Singh, Rajneesh Kler, Pranay Verma, Naina Chaudhary, Astha Gupta
article en
4 citations

Abstract

This paper talks about a new way to make queries for Large Language Models (LLMs) better. We introduce a method called Query Semantic Complexity (QSC). This method helps to understand how complicated user queries are. It is better than older ways of measuring complexity. Next, we created an algorithm called Adaptive Semantic Query Optimization (ASQO). This algorithm changes how queries are processed based on their complexity. Our method uses a special function that looks at two things: how accurate the answers are and how fast they are given. We did many tests with different LLMs, like GPT-3, T5-11B, and BERT-large. The results showed that our method improves how fast queries are processed, how accurate the answers are, and how happy users feel. We also looked at examples in areas like scientific papers and technical documents to show how our method works in real life. Our method is especially good for complicated queries and works well even when the models are bigger. This gives a good way to make query performance better in LLMs.

Amity University (IN)
Openalex Percentile: Top 15%
Natural Language Processing Techniques
1.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Catalyzing Multilingual NLP: New Methods for Low-Resource Language Support — Ayush Thakur, Gurinder Singh, et al. · (2024) | TGRS Research Map | TGRS