An active ensemble classifier for detecting animal sequences from global camera trap data
Abstract Camera traps can generate huge amounts of images, and thus reliable methods for their automated processing are in high demand: in particular to find those images or image sequences that actually include animals. Automatically filtering out images that are empty or contain humans can be challenging, as images can be taken in different landscapes, habitats and light. Weather and seasonal conditions can vary greatly. Most of the images can be empty, because cameras using passive infrared sensors (PIR) trigger easily due to moving vegetation or rapidly varying shadows and sunny spots. Animals in images are often hiding behind vegetation, and camera traps will see them from previously unseen angles. Therefore, conventional animal image detection methods based on deep learning need huge training sets to achieve good accuracy. We present a novel background removal approach based on movement masked images computed using sequences of images. Our deep vision classifier uses these movement images for classification instead of the original images. Additionally, we apply a deep active learning (active learning for deep models) for collecting training samples to reduce the number of annotations required from the user. Our method performed well in singling out image sequences that actually include animals, thus filtering out the majority of images that were empty or contained humans. Most importantly, the method performed well also for backgrounds and animal species not seen in the training data. Active learning brought good separation between classes already with small training sets, without the need for laborious large‐scale pre‐annotation. We present a reliable and efficient method for filtering out empty image sequences and sequences containing humans. This greatly facilitates camera trapping research by enabling researchers to restrict the task of animal classification to only those image sequences that actually contain animals.
Authors
- Margarida Santos‐Reis (ORCID: https://orcid.org/0000-0002-0337-963X)
- Kateřina Sam (ORCID: https://orcid.org/0000-0002-3436-0579)
- Wolfram Remmers
- Stéphane Boyer (ORCID: https://orcid.org/0000-0002-0750-4864)
- Andrea Kaus‐Thiel
- Paula Gonçalves (ORCID: https://orcid.org/0000-0003-2505-4593)
- Otso Ovaskainen (ORCID: https://orcid.org/0000-0001-9750-4421)
- Irmgard Krisai‐Greilhüber (ORCID: https://orcid.org/0000-0003-1078-3080)
- Kirsty Quinlan
- Elli Groner (ORCID: https://orcid.org/0000-0002-7843-3047)
- Stefan Stoll (ORCID: https://orcid.org/0000-0002-3656-417X)
- Adrian Pinder (ORCID: https://orcid.org/0000-0002-9390-7909)
- F. Vannier
- Elise Sivault (ORCID: https://orcid.org/0000-0001-8970-1804)
- Valerie Levesque‐Beaudin (ORCID: https://orcid.org/0000-0002-6053-0949)
- Gergin Blagoev (ORCID: https://orcid.org/0000-0003-1844-0779)
- Bess Hardwick (ORCID: https://orcid.org/0000-0001-5195-6115)
- Markéta Tahadlová (ORCID: https://orcid.org/0000-0003-2985-2963)
- Anna Mrázová (ORCID: https://orcid.org/0000-0002-9268-0896)
- Sébastien Moreau (ORCID: https://orcid.org/0000-0002-7796-310X)
- Lucas Sire (ORCID: https://orcid.org/0000-0002-2911-6109)
- Mikko Pentinsaari (ORCID: https://orcid.org/0000-0001-7241-3873)
- Carlos López‐Vaamonde (ORCID: https://orcid.org/0000-0003-2278-2368)
- Sandra Alcobia (ORCID: https://orcid.org/0000-0002-5200-5183)
- Tommi Mononen (ORCID: https://orcid.org/0000-0002-3603-0813)
- Tereza Vlasatá
- Patrick Strutzenberger (ORCID: https://orcid.org/0000-0003-3278-5693)
- Brigitte Gottsberger (ORCID: https://orcid.org/0000-0002-6317-306X)
- Inês T. Rosário (ORCID: https://orcid.org/0000-0003-1604-1133)
- Chris Ho
- Adrian Barrett
- Lauren Vanderlingen
Institutions
- Université de Tours (FR)
- Centre National de la Recherche Scientifique (FR)
- University of Vienna (AT)
- University of Helsinki (FI)
- Trier University of Applied Sciences (DE)
- Sewanee: The University of the South (US)
- École Pratique des Hautes Études (FR)
- University of South Bohemia in České Budějovice (CZ)
- Sorbonne Université (FR)
- Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR)
- Hochschule Campus Wien (AT)
- Sustainability Institute (ZA)
- Assembly of First Nations (CA)
- Dead Sea and Arava Science Center (IL)
- Institut de Systématique, Évolution, Biodiversité (FR)
- Institute of Entomology (CZ)
- Department of Biodiversity, Conservation and Attractions (AU)
- Universitätszahnklinik Wien (AT)
- AOSOL (Portugal) (PT)
- University of Duisburg-Essen (DE)
- University of Guelph (CA)
- University of Jyväskylä (FI)
Publication Details
- Journal
- Methods in Ecology and Evolution
- Published
- 2025-08-25
- DOI
- https://doi.org/10.1111/2041-210x.70144
- Primary Topic
- Genomics and Phylogenetic Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Grantová Agentura České Republiky
- Horizon 2020 Framework Programme
- Biotieteiden ja Ympäristön Tutkimuksen Toimikunta
- H2020 European Research Council