Improving AI performance in wildlife monitoring through species and environment-specific training: A case study on desert Bighorn sheep

Motion-activated cameras are widely used to monitor wildlife, offering a non-intrusive and cost-effective means to collect high volumes of data. Artificial intelligence (AI) models can expedite image processing, but automated species classifications can be too inaccurate to meet end-users' needs. This study evaluates how selection of data for model training influences AI detection of a focal species (desert bighorn sheep; Ovis canadensis nelsoni ) across similar and novel locations. We compared two AI models: a species-specialist (deep_sheep) and a species-generalist (CameraTrapDetectoR), identified sources of bias, and retrained the specialist model using two datasets targeted toward biases associated with classification failure. Testing on 95,547 images from 36 water sources (5 novel) in the Mojave and Sonoran Deserts revealed the specialist model outperformed the generalist by 21.44 % in accuracy and reduced false negatives by 45.18 %. The specialist model was retrained first on site-representative data, then on both site-representative and extreme image-condition data. Retraining iterations consecutively reduced the false negative rate (36.94 % → 6.23 % → 4.67 %) and improved reliability across sites at the cost of a reciprocal increase in false positive rate (2.87 % → 15.22 % → 23.97 %) and variation. The site-representative retraining had the highest overall accuracy. Accuracy at out-of-sample sites remained comparable to the full dataset, though minor performance declines were observed. We found that specifying an AI's training to single-species classification and conditions within specific environments produced robust classification accuracy at minimal data requirements. By narrowing objectives while ensuring adequate training data variety, we achieved 89.33 % accuracy with a small fraction of the training data required by similar performing models. • Refining AI training data can lead to improved species-identification in targeted contexts. • A species-specific model trained on varied local environments produced the strongest results when predicting in those environments. • AI can predict novel sites from the same region with similar accuracy to training sites if training includes sufficient background variation. • Over-representing problematic or non-typical image qualities in training did not improve overall performance, although the false negative rate decreased. • Trainings that improve false negative rate may also increase false positive rate and limit accuracy gains. • Just under 90 % single-species classification accuracy can be achieved with only 10,000 training images.

Authors

Institutions

Publication Details

Journal
Ecological Informatics
Published
2025-05-02
DOI
https://doi.org/10.1016/j.ecoinf.2025.103179
Citations
2
Primary Topic
Wildlife Ecology and Conservation
Type
article
Field-Weighted Citation Impact
3.43
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving AI performance in wildlife monitoring through species and environment-specific training: A case study on desert Bighorn sheep

Christina M. Aiello, Kate Perkins, Neal W. Darby, Clinton W. Epps et al.
2 citations
Ecological Informatics
Wildlife Ecology and Conservation
3.43
article

Improving AI performance in wildlife monitoring through species and environment-specific training: A case study on desert Bighorn sheep

Christina M. Aiello, Kate Perkins, Neal W. Darby, Clinton W. Epps, Owen S. Okuley, Will Glad, Richard Ianniello
article en
2 citations

Abstract

Motion-activated cameras are widely used to monitor wildlife, offering a non-intrusive and cost-effective means to collect high volumes of data. Artificial intelligence (AI) models can expedite image processing, but automated species classifications can be too inaccurate to meet end-users' needs. This study evaluates how selection of data for model training influences AI detection of a focal species (desert bighorn sheep; Ovis canadensis nelsoni ) across similar and novel locations. We compared two AI models: a species-specialist (deep_sheep) and a species-generalist (CameraTrapDetectoR), identified sources of bias, and retrained the specialist model using two datasets targeted toward biases associated with classification failure. Testing on 95,547 images from 36 water sources (5 novel) in the Mojave and Sonoran Deserts revealed the specialist model outperformed the generalist by 21.44 % in accuracy and reduced false negatives by 45.18 %. The specialist model was retrained first on site-representative data, then on both site-representative and extreme image-condition data. Retraining iterations consecutively reduced the false negative rate (36.94 % → 6.23 % → 4.67 %) and improved reliability across sites at the cost of a reciprocal increase in false positive rate (2.87 % → 15.22 % → 23.97 %) and variation. The site-representative retraining had the highest overall accuracy. Accuracy at out-of-sample sites remained comparable to the full dataset, though minor performance declines were observed. We found that specifying an AI's training to single-species classification and conditions within specific environments produced robust classification accuracy at minimal data requirements. By narrowing objectives while ensuring adequate training data variety, we achieved 89.33 % accuracy with a small fraction of the training data required by similar performing models. • Refining AI training data can lead to improved species-identification in targeted contexts. • A species-specific model trained on varied local environments produced the strongest results when predicting in those environments. • AI can predict novel sites from the same region with similar accuracy to training sites if training includes sufficient background variation. • Over-representing problematic or non-typical image qualities in training did not improve overall performance, although the false negative rate decreased. • Trainings that improve false negative rate may also increase false positive rate and limit accuracy gains. • Just under 90 % single-species classification accuracy can be achieved with only 10,000 training images.

Ecological InformaticsVol. 89
National Park Service (US), Oregon Department of Fish and Wildlife (US), Oregon State University (US), California Department of Fish and Wildlife (US), Johns Hopkins University (US), University of Baltimore (US)
Life in Land
Openalex Percentile: Top 9%
Wildlife Ecology and Conservation
3.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.