Improving AI performance in wildlife monitoring through species and environment-specific training: A case study on desert Bighorn sheep
Motion-activated cameras are widely used to monitor wildlife, offering a non-intrusive and cost-effective means to collect high volumes of data. Artificial intelligence (AI) models can expedite image processing, but automated species classifications can be too inaccurate to meet end-users' needs. This study evaluates how selection of data for model training influences AI detection of a focal species (desert bighorn sheep; Ovis canadensis nelsoni ) across similar and novel locations. We compared two AI models: a species-specialist (deep_sheep) and a species-generalist (CameraTrapDetectoR), identified sources of bias, and retrained the specialist model using two datasets targeted toward biases associated with classification failure. Testing on 95,547 images from 36 water sources (5 novel) in the Mojave and Sonoran Deserts revealed the specialist model outperformed the generalist by 21.44 % in accuracy and reduced false negatives by 45.18 %. The specialist model was retrained first on site-representative data, then on both site-representative and extreme image-condition data. Retraining iterations consecutively reduced the false negative rate (36.94 % → 6.23 % → 4.67 %) and improved reliability across sites at the cost of a reciprocal increase in false positive rate (2.87 % → 15.22 % → 23.97 %) and variation. The site-representative retraining had the highest overall accuracy. Accuracy at out-of-sample sites remained comparable to the full dataset, though minor performance declines were observed. We found that specifying an AI's training to single-species classification and conditions within specific environments produced robust classification accuracy at minimal data requirements. By narrowing objectives while ensuring adequate training data variety, we achieved 89.33 % accuracy with a small fraction of the training data required by similar performing models. • Refining AI training data can lead to improved species-identification in targeted contexts. • A species-specific model trained on varied local environments produced the strongest results when predicting in those environments. • AI can predict novel sites from the same region with similar accuracy to training sites if training includes sufficient background variation. • Over-representing problematic or non-typical image qualities in training did not improve overall performance, although the false negative rate decreased. • Trainings that improve false negative rate may also increase false positive rate and limit accuracy gains. • Just under 90 % single-species classification accuracy can be achieved with only 10,000 training images.
Authors
- Christina M. Aiello (ORCID: https://orcid.org/0000-0002-2399-5464)
- Kate Perkins
- Neal W. Darby
- Clinton W. Epps (ORCID: https://orcid.org/0000-0001-6577-1840)
- Owen S. Okuley
- Will Glad
- Richard Ianniello
Institutions
- National Park Service (US)
- Oregon Department of Fish and Wildlife (US)
- Oregon State University (US)
- California Department of Fish and Wildlife (US)
- Johns Hopkins University (US)
- University of Baltimore (US)
Publication Details
- Journal
- Ecological Informatics
- Published
- 2025-05-02
- DOI
- https://doi.org/10.1016/j.ecoinf.2025.103179
- Citations
- 2
- Primary Topic
- Wildlife Ecology and Conservation
- Type
- article
- Field-Weighted Citation Impact
- 3.43