Task Interference Mitigation via Confidence-Stratified Classifier Calibration for Prompt-based Continual Learning

Prompt-based continual learning is a promising direction that effectively leverages the capabilities of pre-trained models. These methods typically learn task-specific prompts and predict task identity to select the prompt during inference. However, task interference caused by prompt misselection significantly constrains their performance. Although several studies have attempted to mitigate this issue, they treat all samples equally, without specifically addressing the samples that are primarily affected by prompt misselection. In this paper, we stratify samples into three distinct categories according to their different responses to prompt misselection, including susceptible samples, refractory samples, and resilient samples. This stratification reveals that misselection-induced interference primarily manifests in susceptible samples, as only their classification correctness is influenced by prompt misselection, while other samples remain unaffected. This realization drives us to design a novel prompt-based approach called Confidence-Stratified Classifier Calibration (CoSC), which harnesses the complementary roles of all categories to safeguard susceptible samples. Specifically, we apply targeted optimization based on the unique properties of each category to cooperatively calibrate classifiers of both the prompt instruction part and the prompt selector, thereby protecting susceptible samples from dual perspectives. Extensive experiments show that CoSC achieves state-of-the-art performance across various benchmarks in class-incremental learning.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Image Processing
Published
2026-11-17
DOI
https://doi.org/10.1109/tip.2026.3753082
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Task Interference Mitigation via Confidence-Stratified Classifier Calibration for Prompt-based Continual Learning

Changsheng Xu, Baochen Xiong, Xiaoshan Yang, Yaowei Wang et al.
IEEE Transactions on Image Processing
Domain Adaptation and Few-Shot Learning
article

Task Interference Mitigation via Confidence-Stratified Classifier Calibration for Prompt-based Continual Learning

Changsheng Xu, Baochen Xiong, Xiaoshan Yang, Yaowei Wang, Yaguang Song, Kaichen Li
article en

Abstract

Prompt-based continual learning is a promising direction that effectively leverages the capabilities of pre-trained models. These methods typically learn task-specific prompts and predict task identity to select the prompt during inference. However, task interference caused by prompt misselection significantly constrains their performance. Although several studies have attempted to mitigate this issue, they treat all samples equally, without specifically addressing the samples that are primarily affected by prompt misselection. In this paper, we stratify samples into three distinct categories according to their different responses to prompt misselection, including susceptible samples, refractory samples, and resilient samples. This stratification reveals that misselection-induced interference primarily manifests in susceptible samples, as only their classification correctness is influenced by prompt misselection, while other samples remain unaffected. This realization drives us to design a novel prompt-based approach called Confidence-Stratified Classifier Calibration (CoSC), which harnesses the complementary roles of all categories to safeguard susceptible samples. Specifically, we apply targeted optimization based on the unique properties of each category to cooperatively calibrate classifiers of both the prompt instruction part and the prompt selector, thereby protecting susceptible samples from dual perspectives. Extensive experiments show that CoSC achieves state-of-the-art performance across various benchmarks in class-incremental learning.

IEEE Transactions on Image ProcessingVol. PP
Chinese Academy of Sciences (CN), Peng Cheng Laboratory (CN)
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon