From few‐shot learning to data‐efficient intelligence

Abstract Modern artificial intelligence (AI) has achieved remarkable progress by scaling data, model size, and computation. Yet scaling alone does not resolve one of the most fundamental gaps between machine and human intelligence: the ability to learn, adapt, and act from limited experience. This limitation is especially visible when labeled examples, expert feedback, user interactions, or real‐world trials are scarce, costly, or dynamically changing. Humans can often grasp a new concept, adapt to a new goal, or personalize behavior after only a few examples or interactions, but many AI systems remain fragile under the same conditions. My research studies data‐efficient generalization: how learning systems can acquire useful priors, adapt to new tasks, and reuse limited experience under bounded supervision. In this article, I trace a continuous research path from few‐shot learning to meta‐learning, in‐context learning, and data‐efficient agentic learning. I first revisit few‐shot learning as a foundational problem and explain how data‐, model‐, and algorithm‐level priors make learning possible when empirical risk minimization is unreliable. I then describe our work on meta‐learning, where task‐level information and parameter‐efficient adaptation enable fast generalization. Next, I discuss in‐context learning in large language models (LLMs) as an implicit form of learning to learn, and show how its connection to classical meta‐learning provides both theoretical insight and practical guidance. Finally, I turn to large language model (LLM)‐based agents, where data efficiency expands beyond labels to include demonstrations, reasoning traces, tool‐use records, preferences, memory, and feedback. Across AI for science, biomedical knowledge discovery, recommendation, search, and personalization, the common thread is simple: more capable AI should extract more learning signal from less experience.

Authors

Institutions

Publication Details

Journal
AI Magazine
Published
2026-10-19
DOI
https://doi.org/10.1002/aaai.70104
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From few‐shot learning to data‐efficient intelligence

Yaqing Wang
AI Magazine
Domain Adaptation and Few-Shot Learning
article

From few‐shot learning to data‐efficient intelligence

Yaqing Wang
article en

Abstract

Abstract Modern artificial intelligence (AI) has achieved remarkable progress by scaling data, model size, and computation. Yet scaling alone does not resolve one of the most fundamental gaps between machine and human intelligence: the ability to learn, adapt, and act from limited experience. This limitation is especially visible when labeled examples, expert feedback, user interactions, or real‐world trials are scarce, costly, or dynamically changing. Humans can often grasp a new concept, adapt to a new goal, or personalize behavior after only a few examples or interactions, but many AI systems remain fragile under the same conditions. My research studies data‐efficient generalization: how learning systems can acquire useful priors, adapt to new tasks, and reuse limited experience under bounded supervision. In this article, I trace a continuous research path from few‐shot learning to meta‐learning, in‐context learning, and data‐efficient agentic learning. I first revisit few‐shot learning as a foundational problem and explain how data‐, model‐, and algorithm‐level priors make learning possible when empirical risk minimization is unreliable. I then describe our work on meta‐learning, where task‐level information and parameter‐efficient adaptation enable fast generalization. Next, I discuss in‐context learning in large language models (LLMs) as an implicit form of learning to learn, and show how its connection to classical meta‐learning provides both theoretical insight and practical guidance. Finally, I turn to large language model (LLM)‐based agents, where data efficiency expands beyond labels to include demonstrations, reasoning traces, tool‐use records, preferences, memory, and feedback. Across AI for science, biomedical knowledge discovery, recommendation, search, and personalization, the common thread is simple: more capable AI should extract more learning signal from less experience.

AI MagazineVol. 47(4)
Institute of Mathematical Sciences (ES)
Openalex Percentile: Top 13%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.