Multi-view Enhanced Few-shot Action Recognition for Embodied Visual Perception

With the advancement of embodied intelligence, robots are expected to understand human actions in dynamic, real-world environments with limited labeled data. Few-shot action recognition (FSAR) has thus emerged as a critical capability for enabling fast adaptation to new activities. While most current approaches focus on image-based tasks, extending few-shot learning to video is hindered by the complexity of spatiotemporal modeling and the lack of discriminative supervision. In this paper, we propose Multi-view Enhanced CLIP (MvE-CLIP), a novel framework for few-shot action recognition that leverages the strong visual-language priors of CLIP while enhancing its sensitivity to action-specific patterns. We introduce a multi-crop consistency strategy to generate multiple spatial views from video frames and explicitly model their similarities, encouraging the model to learn robust and consistent action representations. To evaluate the effectiveness of our approach, we conduct extensive experiments on two benchmark datasets, HMDB51 and UCF101, under standard few-shot settings. Ablation studies confirm the contribution of each component, and results show that MvE-CLIP outperforms state-of-the-art methods, particularly in challenging cases involving high visual similarity. Our work demonstrates the potential of combining pre-trained vision-language models with multi-view consistency for efficient and generalizable action understanding in data-scarce scenarios.

Authors

Institutions

Publication Details

Published
2025-08-22
DOI
https://doi.org/10.1109/ccris65764.2025.11193021
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-view Enhanced Few-shot Action Recognition for Embodied Visual Perception

Qing Ren, Dezheng Lin, Yang Li, Shuai Li et al.
Human Pose and Action Recognition
article

Multi-view Enhanced Few-shot Action Recognition for Embodied Visual Perception

Qing Ren, Dezheng Lin, Yang Li, Shuai Li, Huiyu Li, Yanlong Cao, Wei Li
article en

Abstract

With the advancement of embodied intelligence, robots are expected to understand human actions in dynamic, real-world environments with limited labeled data. Few-shot action recognition (FSAR) has thus emerged as a critical capability for enabling fast adaptation to new activities. While most current approaches focus on image-based tasks, extending few-shot learning to video is hindered by the complexity of spatiotemporal modeling and the lack of discriminative supervision. In this paper, we propose Multi-view Enhanced CLIP (MvE-CLIP), a novel framework for few-shot action recognition that leverages the strong visual-language priors of CLIP while enhancing its sensitivity to action-specific patterns. We introduce a multi-crop consistency strategy to generate multiple spatial views from video frames and explicitly model their similarities, encouraging the model to learn robust and consistent action representations. To evaluate the effectiveness of our approach, we conduct extensive experiments on two benchmark datasets, HMDB51 and UCF101, under standard few-shot settings. Ablation studies confirm the contribution of each component, and results show that MvE-CLIP outperforms state-of-the-art methods, particularly in challenging cases involving high visual similarity. Our work demonstrates the potential of combining pre-trained vision-language models with multi-view consistency for efficient and generalizable action understanding in data-scarce scenarios.

Intelligent Health (United Kingdom) (GB), Zhejiang University (CN)
Openalex Percentile: Top 71%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.