TCFF-Adapter: Text-Driven Adaption of CLIP for Few-Shot Image Classification

In recent years, few-shot image classification has achieved substantial progress. Although existing methods have achieved promising performance, the limited availability of training data often leads to the problem of model overfitting. Model overfitting affects generalization and restricts the effective transfer of knowledge to unseen classes. Moreover, existing methods maintain independence between the image and text modalities during the encoding process, lacking mutual collaboration. This limitation restricts their ability to fully exploit task-specific semantic relationships between visual concepts and textual descriptions. To address this challenge, we propose a text-driven cross-modal feature fusion adapter (TCFF-Adapter) for few-shot image classification. TCFF-Adapter introduces two core components: a cross-modal feature fusion module that constructs joint representations by aligning image and text semantics, and a text-driven adapter that optimizes fused features and dynamically adjusts feature weights in a meta-learning paradigm. By integrating multimodal knowledge with parameter-efficient tuning, our method achieves robust generalization to unseen data without requiring additional fine-tuning. Extensive experiments on eight benchmark datasets demonstrate that the proposed TCFF-Adapter significantly outperforms various state-of-the-art few-shot image classification methods.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Circuits and Systems for Video Technology
Published
2025-08-26
DOI
https://doi.org/10.1109/tcsvt.2025.3602826
Citations
1
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TCFF-Adapter: Text-Driven Adaption of CLIP for Few-Shot Image Classification

Hanzi Wang, Gang Du, Yan Yan, Xintao Xu et al.
1 citations
IEEE Transactions on Circuits and Systems for Video Technology
Speech Recognition and Synthesis
2.48
article

TCFF-Adapter: Text-Driven Adaption of CLIP for Few-Shot Image Classification

Hanzi Wang, Gang Du, Yan Yan, Xintao Xu, Xuelong Li
article en
1 citations

Abstract

In recent years, few-shot image classification has achieved substantial progress. Although existing methods have achieved promising performance, the limited availability of training data often leads to the problem of model overfitting. Model overfitting affects generalization and restricts the effective transfer of knowledge to unseen classes. Moreover, existing methods maintain independence between the image and text modalities during the encoding process, lacking mutual collaboration. This limitation restricts their ability to fully exploit task-specific semantic relationships between visual concepts and textual descriptions. To address this challenge, we propose a text-driven cross-modal feature fusion adapter (TCFF-Adapter) for few-shot image classification. TCFF-Adapter introduces two core components: a cross-modal feature fusion module that constructs joint representations by aligning image and text semantics, and a text-driven adapter that optimizes fused features and dynamically adjusts feature weights in a meta-learning paradigm. By integrating multimodal knowledge with parameter-efficient tuning, our method achieves robust generalization to unseen data without requiring additional fine-tuning. Extensive experiments on eight benchmark datasets demonstrate that the proposed TCFF-Adapter significantly outperforms various state-of-the-art few-shot image classification methods.

IEEE Transactions on Circuits and Systems for Video TechnologyVol. 36(2)
Xiamen University (CN), China Telecom (China) (CN), China Telecom (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 9%
Speech Recognition and Synthesis
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

TCFF-Adapter: Text-Driven Adaption of CLIP for Few-Shot Image Classification — Hanzi Wang, Gang Du, et al. · IEEE Transactions on Circuits and Systems for Video Technology (2025) | TGRS Research Map | TGRS