Category Name Expansion and an Enhanced Multimodal Fusion Framework for Few-Shot Learning

With the advancement of image processing techniques, few-shot learning (FSL) has gradually become a key approach to addressing the problem of data scarcity. However, existing FSL methods often rely on unimodal information under limited sample conditions, making it difficult to capture fine-grained differences between categories. To address this issue, we propose a multimodal few-shot learning method based on category name expansion and image feature enhancement. By integrating the expanded category text with image features, the proposed method enriches the semantic representation of categories and enhances the model's sensitivity to detailed features. To further improve the quality of cross-modal information transfer, we introduce a cross-modal residual connection strategy that aligns features across layers through progressive fusion. This approach enables the fused representations to maximize mutual information while reducing redundancy, effectively alleviating the information bottleneck caused by uneven entropy distribution between modalities and enhancing the model's generalization ability. Experimental results demonstrate that our method achieves superior performance on both natural image datasets (CIFAR-FS and FC100) and a medical image dataset.

Authors

Institutions

Publication Details

Journal
Entropy
Published
2025-09-22
DOI
https://doi.org/10.3390/e27090991
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Category Name Expansion and an Enhanced Multimodal Fusion Framework for Few-Shot Learning

Lei Lyu, Xiaoyun Xie, Minglei Shu, Tianlei Gao et al.
Entropy
Domain Adaptation and Few-Shot Learning
article

Category Name Expansion and an Enhanced Multimodal Fusion Framework for Few-Shot Learning

Lei Lyu, Xiaoyun Xie, Minglei Shu, Tianlei Gao, Nuo Wei, Yushui Geng
article en

Abstract

With the advancement of image processing techniques, few-shot learning (FSL) has gradually become a key approach to addressing the problem of data scarcity. However, existing FSL methods often rely on unimodal information under limited sample conditions, making it difficult to capture fine-grained differences between categories. To address this issue, we propose a multimodal few-shot learning method based on category name expansion and image feature enhancement. By integrating the expanded category text with image features, the proposed method enriches the semantic representation of categories and enhances the model's sensitivity to detailed features. To further improve the quality of cross-modal information transfer, we introduce a cross-modal residual connection strategy that aligns features across layers through progressive fusion. This approach enables the fused representations to maximize mutual information while reducing redundancy, effectively alleviating the information bottleneck caused by uneven entropy distribution between modalities and enhancing the model's generalization ability. Experimental results demonstrate that our method achieves superior performance on both natural image datasets (CIFAR-FS and FC100) and a medical image dataset.

EntropyVol. 27(9)
Qilu University of Technology (CN), Shandong Normal University (CN), Shandong Academy of Sciences (CN), Shandong University of Science and Technology (CN)
Openalex Percentile: Top 86%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Category Name Expansion and an Enhanced Multimodal Fusion Framework for Few-Shot Learning — Lei Lyu, Xiaoyun Xie, et al. · Entropy (2025) | TGRS Research Map | TGRS