Limitations of Large Language Models

Large Language Models (LLMs) have become a cornerstone of modern natural language processing, exhibiting remarkable capabilities in diverse applications. However, these models are not flawless. This paper provides a comprehensive analysis of the loopholes inherent in LLMs, focusing on adversarial attacks, biases, hallucinations and outdatedness. One of the main problems is hallucinations, where models generate plausible but inaccurate or unreal information. Biases introduced into training data can lead to outcomes that reflect and amplify societal prejudices leading to discriminatory behavior. Adversarial attacks exploit vulnerabilities in machine learning models by introducing subtle perturbations to input data, causing the model to make incorrect predictions with high confidence. Additionally, LLMs considerably struggle when it comes to domain-specific queries as they lack specialized knowledge and have a generalized training, thus highlighting the need for domain-specific customization. By inspecting these vulnerabilities, we aim to highlight the critical areas that require attention to ensure the safe and effective deployment of LLMs.

Authors

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/csitss64042.2024.10817070
Citations
5
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Limitations of Large Language Models

Erin Sanu, T Keerthi Amudaa, Prasiddha Bhat, Guduru Dinesh et al.
5 citations
Topic Modeling
1.74
article

Limitations of Large Language Models

Erin Sanu, T Keerthi Amudaa, Prasiddha Bhat, Guduru Dinesh, Apoorva Uday Kumar Chate, Ramakanth Kumar P
article en
5 citations

Abstract

Large Language Models (LLMs) have become a cornerstone of modern natural language processing, exhibiting remarkable capabilities in diverse applications. However, these models are not flawless. This paper provides a comprehensive analysis of the loopholes inherent in LLMs, focusing on adversarial attacks, biases, hallucinations and outdatedness. One of the main problems is hallucinations, where models generate plausible but inaccurate or unreal information. Biases introduced into training data can lead to outcomes that reflect and amplify societal prejudices leading to discriminatory behavior. Adversarial attacks exploit vulnerabilities in machine learning models by introducing subtle perturbations to input data, causing the model to make incorrect predictions with high confidence. Additionally, LLMs considerably struggle when it comes to domain-specific queries as they lack specialized knowledge and have a generalized training, thus highlighting the need for domain-specific customization. By inspecting these vulnerabilities, we aim to highlight the critical areas that require attention to ensure the safe and effective deployment of LLMs.

Openalex Percentile: Top 12%
Topic Modeling
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Limitations of Large Language Models — Erin Sanu, T Keerthi Amudaa, et al. · (2024) | TGRS Research Map | TGRS