Enhancing pollinator conservation: Monitoring of bees through object recognition
In an era of rapid climate change and its adverse effects on food production, technological intervention to monitor pollinator conservation is of paramount importance for environmental monitoring and conservation for global food security. The survival of the human species depends on the conservation of pollinators. This article explores the use of Computer Vision and Object Recognition to autonomously track and report bee behaviour from images. A novel dataset of 9664 images containing bees is extracted from video streams and annotated with bounding boxes. With training, validation and testing sets (6722, 1915, and 997 images, respectively), the results of the COCO-based YOLO model fine-tuning approaches show that YOLOv5 m is the most effective approach in terms of recognition accuracy. However, YOLOv5s was shown to be the most optimal for real-time bee detection with an average processing and inference time of 5.1 ms per video frame at the cost of slightly lower ability. The trained model is then packaged within an explainable AI interface, which converts detection events into timestamped reports and charts, with the aim of facilitating use by non-technical users such as expert stakeholders from the apiculture industry towards informing responsible consumption and production. • Novel dataset of 9,664 bee images is collected, labelled and released open source. • YOLOv5 m model achieves 85.6% [email protected], real-time inference of 8.1 ms per video frame. • YOLOv5s model achieves 84.6% [email protected], real-time inference of 5.1 ms per video frame. • Explainable AI interface distils model inference for non-technical stakeholders.
Authors
- Pedro Machado (ORCID: https://orcid.org/0000-0003-1760-3871)
- Gábor Markó (ORCID: https://orcid.org/0000-0003-1351-4070)
- Martin Bencsik (ORCID: https://orcid.org/0000-0002-6278-0378)
- Isibor Kennedy Ihianle (ORCID: https://orcid.org/0000-0001-7445-8573)
- Jordan J. Bird (ORCID: https://orcid.org/0000-0002-9858-1231)
- Chloe M. Barnes (ORCID: https://orcid.org/0000-0002-6782-1773)
- Ajay John Alex
Institutions
- Aston University (GB)
- Hungarian Astronomical Association (HU)
- Nottingham Trent University (GB)
Publication Details
- Journal
- Computers and Electronics in Agriculture
- Published
- 2024-11-28
- DOI
- https://doi.org/10.1016/j.compag.2024.109665
- Citations
- 4
- Primary Topic
- Plant and animal studies
- Type
- article
- Field-Weighted Citation Impact
- 4.12