FSLNet: Leveraging Skeleton Cue Guided FBIC for Bionic Intelligent Surveillance Robot via Transformer

Fine-grained bird image classification (FBIC) plays a critical role in robotic vision tracking and monitoring of endangered bird species. Traditional surveillance robots often face major challenges when operating in complex environments, especially under extreme conditions involving occlusions and complex backgrounds. To overcome these limitations, we developed a novel bionic intelligent surveillance robot that incorporates FSLNet - a fine-grained skeletal learning network that integrates skeletal tokens into a Vision Transformer (ViT) framework. Unlike traditional CNN-based models, FSLNet leverages skeletal tokens to capture key invariant features, improving the ability to distinguish between visually similar bird species under challenging circumstances. The architecture of our model includes visual token construction, skeleton token construction, and a transformer-based backbone for thorough feature learning. Extensive experiments on CUB-200-2011 and NABirds datasets demonstrate that our method achieves superior performance compared to state-of-the-art approaches.

Authors

Institutions

Publication Details

Published
2024-12-10
DOI
https://doi.org/10.1109/robio64047.2024.10907521
Primary Topic
Modular Robots and Swarm Intelligence
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FSLNet: Leveraging Skeleton Cue Guided FBIC for Bionic Intelligent Surveillance Robot via Transformer

Zhibing Liu, Zhaoli Zhang, Yongjian Deng, Qiang Chen et al.
Modular Robots and Swarm Intelligence
article

FSLNet: Leveraging Skeleton Cue Guided FBIC for Bionic Intelligent Surveillance Robot via Transformer

Zhibing Liu, Zhaoli Zhang, Yongjian Deng, Qiang Chen, Youfu Li, Hai Liu
article en

Abstract

Fine-grained bird image classification (FBIC) plays a critical role in robotic vision tracking and monitoring of endangered bird species. Traditional surveillance robots often face major challenges when operating in complex environments, especially under extreme conditions involving occlusions and complex backgrounds. To overcome these limitations, we developed a novel bionic intelligent surveillance robot that incorporates FSLNet - a fine-grained skeletal learning network that integrates skeletal tokens into a Vision Transformer (ViT) framework. Unlike traditional CNN-based models, FSLNet leverages skeletal tokens to capture key invariant features, improving the ability to distinguish between visually similar bird species under challenging circumstances. The architecture of our model includes visual token construction, skeleton token construction, and a transformer-based backbone for thorough feature learning. Extensive experiments on CUB-200-2011 and NABirds datasets demonstrate that our method achieves superior performance compared to state-of-the-art approaches.

City University of Hong Kong (HK), Beijing University of Technology (CN), Central China Normal University (CN)
National Natural Science Foundation of China, Research Grants Council, University Grants Committee, Natural Science Foundation of Hubei Province, Natural Science Foundation of Jiangxi Province, National Key Research and Development Program of China
Affordable and clean energy
Openalex Percentile: Top 72%
Modular Robots and Swarm Intelligence
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.