Comparative Analysis of Zero-shot, Few-shot, and One-shot Learning in Natural Language Processing

Recent advancements in Natural Language Processing (NLP) [1] have been significantly influenced by various learning paradigms, notably Zero-shot, Few-shot, and One-shot learning. This paper presents a comprehensive comparative analysis of these paradigms, detailing their methodologies, performance metrics, and applicability to diverse NLP tasks. Zero-shot learning models, such as GPT-4 and Flan-T5, demonstrate robust performance without task-specific training but require substantial computational resources. Few-shot learning, leveraging models like GPT-3.5-turbo and Flan-T5, balances efficiency and accuracy, achieving near state-of-the-art performance with minimal data. One-shot learning, exemplified by Siamese Networks, shows promise in highly constrained data environments but generally underperforms in complex NLP tasks compared to few-shot learning. Through experimental evaluations on benchmark datasets, this paper highlights the strengths and limitations of each approach, providing insights into their practical implications and future research directions

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/ariia63345.2024.11051380
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Analysis of Zero-shot, Few-shot, and One-shot Learning in Natural Language Processing

Mukundraj Raman Sudarshan, Chandrashekhar Kumbhar
Domain Adaptation and Few-Shot Learning
article

Comparative Analysis of Zero-shot, Few-shot, and One-shot Learning in Natural Language Processing

Mukundraj Raman Sudarshan, Chandrashekhar Kumbhar
article en

Abstract

Recent advancements in Natural Language Processing (NLP) [1] have been significantly influenced by various learning paradigms, notably Zero-shot, Few-shot, and One-shot learning. This paper presents a comprehensive comparative analysis of these paradigms, detailing their methodologies, performance metrics, and applicability to diverse NLP tasks. Zero-shot learning models, such as GPT-4 and Flan-T5, demonstrate robust performance without task-specific training but require substantial computational resources. Few-shot learning, leveraging models like GPT-3.5-turbo and Flan-T5, balances efficiency and accuracy, achieving near state-of-the-art performance with minimal data. One-shot learning, exemplified by Siamese Networks, shows promise in highly constrained data environments but generally underperforms in complex NLP tasks compared to few-shot learning. Through experimental evaluations on benchmark datasets, this paper highlights the strengths and limitations of each approach, providing insights into their practical implications and future research directions

New York University (US), Singapore Management University (SG)
Quality Education
Openalex Percentile: Top 72%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Comparative Analysis of Zero-shot, Few-shot, and One-shot Learning in Natural Language Processing — Mukundraj Raman Sudarshan, Chandrashekhar Kumbhar · (2024) | TGRS Research Map | TGRS