Machine learning-based bee recognition and tracking for advancing insect behavior research

The study of insect behavior, particularly that of honey bees, has a broad scope and significance. Tracking bee flying patterns grants much helpful information about bee behavior. However, tracking a small yet fast-moving object, such as a bee, is difficult. Hence, we present artificial intelligence, machine-learning-based bee recognition, and tracking systems to assist the researcher in studying the bee’s behavior. To develop a machine learning system, a labeled database is required for model training. To address this, we implemented an automated system for analyzing and labeling bee videos. This labeled database served as the foundation for two distinct bee-tracking solutions. The first solution (planar bee tracking system) tracked individual bees in closed mazes using a neural network. The second solution (spatial bee tracking system) utilized a neural network and a tracking algorithm to identify and track flying bees in open environments. Both systems tackle the challenge of tracking small-bodied creatures with rapid and diverse movement patterns. Although we applied these systems to entomological cognition research in this paper, their relevance extends to general insect research and developing tracking solutions for small organisms with swift movements. We present the complete architecture and detailed methodologies to facilitate the utilization of these models in future research endeavors. Our approach is a simple and inexpensive method that contributes to the growing number of image-analysis tools used for tracking animal movement, with future potential applications under less sterile field conditions. The tools presented in this paper could assist the study of movement ecology, specifically in insects, by providing accurate movement specifications. Following the movement of pollinators or natural enemies, for example, greatly contributes to the study of pollination or biological control, respectively, in natural and agro-ecosystems.