Essential tools but overlooked bias: Artificial intelligence and citizen science classification affect camera trap data
Abstract Camera trapping generates vast image datasets requiring classification before downstream ecological inference, yet the influence of classification errors on subsequent analyses is often overlooked. Classification performance can vary widely depending on the classification method (e.g. citizen science vs. artificial intelligence [AI]), species, illumination conditions (diurnal vs. nocturnal) and other contextual factors. We compared a citizen science classification method to two AI classifiers (EfficientNet and DeepFaune) using an expert‐labelled hold‐out of 51,588 images across seven classes (‘empty’, ‘human’, ‘cervid’, ‘wild boar’, ‘red fox’, ‘leporid’ and ‘European badger’) captured day and night. For each class and method, we quantified precision (accuracy of positive predictions) and recall (ability to detect all positive instances), then fitted single‐season occupancy models to the classified data and compared estimates against expert‐derived benchmarks. Finally, we conducted a large‐scale simulation to investigate how true occupancy, detection probability and classification performance (recall and precision) collectively influence the accuracy (root mean square error [RMSE]) of occupancy estimates. Citizen scientists exhibited consistently high precision but more variable recall. The AI classifiers outperformed the citizen science method in recall for several species, including wild boar, leporid and European badger. Both approaches performed worse on nocturnal images and showed reduced precision for night‐time ‘empty’ images. Bias in occupancy estimates differed across species, methods and space—the AI‐based estimates were generally more biased, with both the magnitude and direction of bias varying spatially, especially for rarer species such as leporids. In our simulation study, precision emerged as the strongest predictor of occupancy model accuracy, with lower precision substantially increasing RMSE. Lower occupancy rates increased RMSE, and precision regulated the impact of detection probability: at low precision, higher detection probability worsened errors; at high precision, RMSE remained low—or even decreased—as detection probability rose. Although AI classifiers offer unmatched processing speed, our findings show that citizen science can reduce classification errors. Moreover, low precision and poor recall, especially for rare or nocturnal species, can substantially bias occupancy models. Based on our results, we recommend improving precision and accounting for classification quality and uncertainty to ensure robust inference from camera trap data.
Authors
- Nuria Selva (ORCID: https://orcid.org/0000-0003-3389-201X)
- Javier Calzada (ORCID: https://orcid.org/0000-0001-5701-2238)
- Jon Paul Rodrı́guez (ORCID: https://orcid.org/0000-0001-5019-2870)
- Paul D. Meek (ORCID: https://orcid.org/0000-0002-3792-5723)
- Simone Tenan (ORCID: https://orcid.org/0000-0001-5055-9193)
- Kate Brandis (ORCID: https://orcid.org/0000-0001-6807-0142)
- Eloy Revilla (ORCID: https://orcid.org/0000-0001-5534-5581)
- Sara Beery (ORCID: https://orcid.org/0000-0002-2544-1844)
- Simone Santoro (ORCID: https://orcid.org/0000-0003-0986-3278)
- Alessio Mortelliti (ORCID: https://orcid.org/0000-0003-0480-6100)
- Santiago Gutiérrez‐Zapata (ORCID: https://orcid.org/0000-0002-9162-4331)
- Lenka Straková
Institutions
- University of Trieste (IT)
- Instituto Venezolano de Investigaciones Científicas (VE)
- University of South-Eastern Norway (NO)
- New South Wales Department of Primary Industries (AU)
- UNSW Sydney (AU)
- Institute of Biosciences and Bioresources (IT)
- Institute of Nature Conservation (PL)
- National Research Council (LK)
- National Research Council (IT)
- Massachusetts Institute of Technology (US)
- Universidad de Huelva (ES)
- Polish Academy of Sciences (PL)
Publication Details
- Journal
- Methods in Ecology and Evolution
- Published
- 2025-09-25
- DOI
- https://doi.org/10.1111/2041-210x.70132
- Citations
- 1
- Primary Topic
- Species Distribution and Climate Change
- Type
- article
- Field-Weighted Citation Impact
- 1.84
Funders
- Biodiversa+
- European Commission
- Deutsche Forschungsgemeinschaft
- Norges Forskningsråd
- Universidad de Huelva
- Fundación Biodiversidad
- Ministerio para la Transición Ecológica y el Reto Demográfico
- Agencia Estatal de Investigación