Exploiting Ensemble Learning for Cross-View Isolated Sign Language Recognition
In this paper, we present our solution to the Cross-View Isolated Sign Language Recognition (CV-ISLR) challenge held at WWW 2025. CV-ISLR addresses a critical issue in traditional Isolated Sign Language Recognition (ISLR), where existing datasets predominantly capture sign language videos from a frontal perspective, while real-world camera angles often vary. To accurately recognize sign language from different viewpoints, models must be capable of understanding gestures from multiple angles, making cross-view recognition challenging. To address this, we explore the advantages of ensemble learning, which enhances model robustness and generalization across diverse views. Our approach, built on a multi-dimensional Video Swin Transformer model, leverages this ensemble strategy to achieve competitive performance. Finally, our solution ranked 3rd in both the RGB-based ISLR and RGB-D-based ISLR tracks, demonstrating the effectiveness in handling the challenges of cross-view recognition. The code is available at: https://github.com/Jiafei127/CV_ISLR_WWW2025.
Authors
- Zhiliang Wu (ORCID: https://orcid.org/0000-0002-6597-8048)
- Yanyan Wei (ORCID: https://orcid.org/0000-0001-8818-6740)
- Peng Zou
- Yiqi Nie (ORCID: https://orcid.org/0009-0001-1739-4515)
- Zhangling Duan (ORCID: https://orcid.org/0000-0003-3246-8022)
- Kun Li (ORCID: https://orcid.org/0000-0001-5083-2145)
- Yuwei Wang (ORCID: https://orcid.org/0000-0003-4282-9821)
- Fei Wang (ORCID: https://orcid.org/0009-0004-1142-6434)
Institutions
- Anhui Agricultural University (CN)
- Anhui University (CN)
- Hefei University of Technology (CN)
- Zhejiang University (CN)
Publication Details
- Published
- 2025-05-08
- DOI
- https://doi.org/10.1145/3701716.3717518
- Citations
- 2
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 3.87