FSLNet: Leveraging Skeleton Cue Guided FBIC for Bionic Intelligent Surveillance Robot via Transformer
Fine-grained bird image classification (FBIC) plays a critical role in robotic vision tracking and monitoring of endangered bird species. Traditional surveillance robots often face major challenges when operating in complex environments, especially under extreme conditions involving occlusions and complex backgrounds. To overcome these limitations, we developed a novel bionic intelligent surveillance robot that incorporates FSLNet - a fine-grained skeletal learning network that integrates skeletal tokens into a Vision Transformer (ViT) framework. Unlike traditional CNN-based models, FSLNet leverages skeletal tokens to capture key invariant features, improving the ability to distinguish between visually similar bird species under challenging circumstances. The architecture of our model includes visual token construction, skeleton token construction, and a transformer-based backbone for thorough feature learning. Extensive experiments on CUB-200-2011 and NABirds datasets demonstrate that our method achieves superior performance compared to state-of-the-art approaches.
Authors
- Zhibing Liu (ORCID: https://orcid.org/0000-0003-4991-6960)
- Zhaoli Zhang (ORCID: https://orcid.org/0000-0002-0844-0719)
- Yongjian Deng (ORCID: https://orcid.org/0000-0001-6253-3564)
- Qiang Chen (ORCID: https://orcid.org/0000-0003-0373-4459)
- Youfu Li (ORCID: https://orcid.org/0000-0002-5227-1326)
- Hai Liu (ORCID: https://orcid.org/0000-0002-6146-5464)
Institutions
- City University of Hong Kong (HK)
- Beijing University of Technology (CN)
- Central China Normal University (CN)
Publication Details
- Published
- 2024-12-10
- DOI
- https://doi.org/10.1109/robio64047.2024.10907521
- Primary Topic
- Modular Robots and Swarm Intelligence
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Research Grants Council, University Grants Committee
- Natural Science Foundation of Hubei Province
- Natural Science Foundation of Jiangxi Province
- National Key Research and Development Program of China