A Prompt Learning Framework with Large Language Model Augmentation for Few-shot Multi-label Intent Detection

Intent detection (ID) is essential in spoken language understanding, especially in multi-label settings where intent labels are interdependent and diverse. Existing methods like SE-MLP and QA-FT struggle in few-shot settings, due to limited data availability and efficiency concerns. To address this, we introduce a Prompt Learning framework with large language Model Augmentation (PLMA) for few-shot multi-label ID. In this study, we make three contributions. First, PLMA integrates large language models (LLMs) with small language models (SLMs), using LLMs to enhance SLMs, with prompt learning as the core framework. Second, it leverages LLMs to improve the model’s understanding of both queries and labels by intent spans extraction and answer space expansion. Third, PLMA refines the QA-FT. A novel QA format template is designed to allow single-step training and inference for each input, improving efficiency. Experiments on NLU++ show that PLMA significantly outperforms other baselines in both in-domain and cross-domain settings, demonstrating its effectiveness in combining the strengths of both small and large models.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10888364
Citations
2
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
4.96

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Prompt Learning Framework with Large Language Model Augmentation for Few-shot Multi-label Intent Detection

Junlei Li, Jianwu Dang, Xiao Wei, Nan Zhuang et al.
2 citations
Text and Document Classification Technologies
4.96
article

A Prompt Learning Framework with Large Language Model Augmentation for Few-shot Multi-label Intent Detection

Junlei Li, Jianwu Dang, Xiao Wei, Nan Zhuang, Chenyang Wang, Longbiao Wang, Xiaobao Wang
article en
2 citations

Abstract

Intent detection (ID) is essential in spoken language understanding, especially in multi-label settings where intent labels are interdependent and diverse. Existing methods like SE-MLP and QA-FT struggle in few-shot settings, due to limited data availability and efficiency concerns. To address this, we introduce a Prompt Learning framework with large language Model Augmentation (PLMA) for few-shot multi-label ID. In this study, we make three contributions. First, PLMA integrates large language models (LLMs) with small language models (SLMs), using LLMs to enhance SLMs, with prompt learning as the core framework. Second, it leverages LLMs to improve the model’s understanding of both queries and labels by intent spans extraction and answer space expansion. Third, PLMA refines the QA-FT. A novel QA format template is designed to allow single-step training and inference for each input, improving efficiency. Experiments on NLU++ show that PLMA significantly outperforms other baselines in both in-domain and cross-domain settings, demonstrating its effectiveness in combining the strengths of both small and large models.

Tianjin University (CN), Chinese Academy of Sciences (CN), Peng Cheng Laboratory (CN), Shenzhen Institutes of Advanced Technology (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 6%
Text and Document Classification Technologies
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.