Reliable and efficient integration of AI into camera traps for smart wildlife monitoring based on continual learning

In this paper, we comprehensively report on an efficient approach for the integration of artificial intelligence (AI) processing pipelines in camera traps for smart on-site wildlife monitoring. Our work covers hardware, software, and algorithmics. We have built two prototypes of smart camera trap on a maximum bill of materials of 100$. We have also built two datasets, made publicly available, comprising over 17 k images, many of them notably challenging even for humans. Leveraging our broad expertise on embedded systems, specialized software libraries and toolchains, and AI techniques such as transfer learning, explainable AI, and, most importantly, continual learning, we achieve more reliable inference on-site - specifically 10 % higher F1-score - than MegaDetector run off-site on a desktop computer. The paper includes many practical details on system realization and on-site training in addition to a vast set of lab and experimental results. • Implementation of a completely functional 100$ smart camera trap prototype. • Collection of over 17 k real-world images, publicly available. • Code developed for smart camera operation and on-device training publicly available. • 10 % higher F1-score of our prototype, achieved on-site, than desktop MegaDetector. • Realization of on-site continual learning based on real and synthetic images.

Authors

Institutions

Publication Details

Journal
Ecological Informatics
Published
2024-09-08
DOI
https://doi.org/10.1016/j.ecoinf.2024.102815
Citations
23
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
7.99

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reliable and efficient integration of AI into camera traps for smart wildlife monitoring based on continual learning

Francisço Palomares, Ricardo Carmona‐Galán, Ariadna Sanglas, Delia Velasco-Montero et al.
23 citations
Ecological Informatics
Domain Adaptation and Few-Shot Learning
7.99
article

Reliable and efficient integration of AI into camera traps for smart wildlife monitoring based on continual learning

Francisço Palomares, Ricardo Carmona‐Galán, Ariadna Sanglas, Delia Velasco-Montero, Jorge Fernández‐Berni
article en
23 citations

Abstract

In this paper, we comprehensively report on an efficient approach for the integration of artificial intelligence (AI) processing pipelines in camera traps for smart on-site wildlife monitoring. Our work covers hardware, software, and algorithmics. We have built two prototypes of smart camera trap on a maximum bill of materials of 100$. We have also built two datasets, made publicly available, comprising over 17 k images, many of them notably challenging even for humans. Leveraging our broad expertise on embedded systems, specialized software libraries and toolchains, and AI techniques such as transfer learning, explainable AI, and, most importantly, continual learning, we achieve more reliable inference on-site - specifically 10 % higher F1-score - than MegaDetector run off-site on a desktop computer. The paper includes many practical details on system realization and on-site training in addition to a vast set of lab and experimental results. • Implementation of a completely functional 100$ smart camera trap prototype. • Collection of over 17 k real-world images, publicly available. • Code developed for smart camera operation and on-device training publicly available. • 10 % higher F1-score of our prototype, achieved on-site, than desktop MegaDetector. • Realization of on-site continual learning based on real and synthetic images.

Ecological InformaticsVol. 83
Estación Biológica de Doñana (ES), Instituto de Microelectrónica de Sevilla (ES)
Ministerio de Ciencia, Innovación y Universidades, European Commission, Ministerio de Ciencia e Innovación, LifeWatch – Niclas Öberg Foundation, Ministerio de Asuntos Económicos y Transformación Digital, Gobierno de España, Junta de Andalucía, European Regional Development Fund, Agencia Estatal de Investigación
Life in Land
Openalex Percentile: Top 2%
Domain Adaptation and Few-Shot Learning
7.99
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.