Query-Aware Cross-Mixup and Cross-Reconstruction for Few-Shot Fine-Grained Image Classification

Few-shot fine-grained image classification is prominent but challenging in computer vision, aiming to distinguish sub-classes under the same parent class but with only a few labeled support samples. Data augmentation techniques were explored to address the few-shot issue, but they often fail to mitigate the bias between support and query samples. Therefore, in this paper we propose a query-aware cross-mixup and cross-reconstruction method to address both few-shot and fine-grained issues. Specifically, in the training phase, we randomly select query samples and mix them with the support samples from the same class to augment the support set. This first strategy ensures the augmented support set query-aware within each sub-class. Then, we reconstruct both query samples and support samples from both original and cross-mixed support samples, thus leveraging both cross-reconstruction and self-reconstruction to enhance classification. This second strategy, enabling the reconstruction also query-aware, further mitigates the bias between support and query samples, leading to more reliable generalization. We evaluate our proposed method on four widely used few-shot fine-grained image classification datasets, and experimental results demonstrate its effectiveness in achieving the state-of-the-art classification performance.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Circuits and Systems for Video Technology
Published
2024-10-22
DOI
https://doi.org/10.1109/tcsvt.2024.3484530
Citations
5
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
1.74

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Query-Aware Cross-Mixup and Cross-Reconstruction for Few-Shot Fine-Grained Image Classification

Dongliang Chang, Zhanyu Ma, Rui Zhu, Jing‐Hao Xue et al.
5 citations
IEEE Transactions on Circuits and Systems for Video Technology
Domain Adaptation and Few-Shot Learning
1.74
article

Query-Aware Cross-Mixup and Cross-Reconstruction for Few-Shot Fine-Grained Image Classification

Dongliang Chang, Zhanyu Ma, Rui Zhu, Jing‐Hao Xue, Xiaoxu Li, Zhimin Zhang
article en
5 citations

Abstract

Few-shot fine-grained image classification is prominent but challenging in computer vision, aiming to distinguish sub-classes under the same parent class but with only a few labeled support samples. Data augmentation techniques were explored to address the few-shot issue, but they often fail to mitigate the bias between support and query samples. Therefore, in this paper we propose a query-aware cross-mixup and cross-reconstruction method to address both few-shot and fine-grained issues. Specifically, in the training phase, we randomly select query samples and mix them with the support samples from the same class to augment the support set. This first strategy ensures the augmented support set query-aware within each sub-class. Then, we reconstruct both query samples and support samples from both original and cross-mixed support samples, thus leveraging both cross-reconstruction and self-reconstruction to enhance classification. This second strategy, enabling the reconstruction also query-aware, further mitigates the bias between support and query samples, leading to more reliable generalization. We evaluate our proposed method on four widely used few-shot fine-grained image classification datasets, and experimental results demonstrate its effectiveness in achieving the state-of-the-art classification performance.

IEEE Transactions on Circuits and Systems for Video TechnologyVol. 35(2)
Beijing University of Posts and Telecommunications (CN), City, University of London (GB), Lanzhou University of Technology (CN), University College London (GB), Tsinghua University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 13%
Domain Adaptation and Few-Shot Learning
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.