A Method for Conveying Confidence in iNaturalist Observations: A Case Study Using Non‐Native Marine Species

Concerns and limitations relating to data quality, reliability and accuracy hamper the use of citizen science initiatives in research and conservation. Valued for their cost-effective and large data acquisition potential, citizen science platforms such as iNaturalist have been highlighted as beneficial tools to supplement monitoring using traditional data sources. However, intrinsic uncertainties in unverified observations stem from the nature of species being identified, the quality of uploaded media and georeferencing; these factors can limit the value of the data as they can result in inaccurate records. Verification of data prior to use is critical. This process can, however, be laborious and time-consuming, with bias associated with the individual responsible for the task. To address this challenge this study developed a protocol for assigning confidence in iNaturalist observations, using marine alien and cryptogenic species observations from South Africa as a case study. A positive relationship was found between the accuracy of observations and confidence score. The inherent data quality assessment in iNaturalist, termed quality grade, was found to be an inadequate proxy for accuracy. The results of this study highlight the importance of the expert verification phase when using citizen science data. The confidence score facilitates a streamlined approach to the verification process by reducing the time taken to validate records, while assessing the three levels of uncertainty within observations and reducing researcher bias. It is recommended that this confidence score be used as an essential tool when using citizen science derived data.

Authors

Institutions

Publication Details

Journal
Ecology and Evolution
Published
2024-10-01
DOI
https://doi.org/10.1002/ece3.70376
Citations
13
Primary Topic
Species Distribution and Climate Change
Type
article
Field-Weighted Citation Impact
11.95
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Method for Conveying Confidence in iNaturalist Observations: A Case Study Using Non‐Native Marine Species

Tamara B. Robinson, David M. Richardson, Sarah Jane Ackland
13 citations
Ecology and Evolution
Species Distribution and Climate Change
11.95
article

A Method for Conveying Confidence in iNaturalist Observations: A Case Study Using Non‐Native Marine Species

Tamara B. Robinson, David M. Richardson, Sarah Jane Ackland
article en
13 citations

Abstract

Concerns and limitations relating to data quality, reliability and accuracy hamper the use of citizen science initiatives in research and conservation. Valued for their cost-effective and large data acquisition potential, citizen science platforms such as iNaturalist have been highlighted as beneficial tools to supplement monitoring using traditional data sources. However, intrinsic uncertainties in unverified observations stem from the nature of species being identified, the quality of uploaded media and georeferencing; these factors can limit the value of the data as they can result in inaccurate records. Verification of data prior to use is critical. This process can, however, be laborious and time-consuming, with bias associated with the individual responsible for the task. To address this challenge this study developed a protocol for assigning confidence in iNaturalist observations, using marine alien and cryptogenic species observations from South Africa as a case study. A positive relationship was found between the accuracy of observations and confidence score. The inherent data quality assessment in iNaturalist, termed quality grade, was found to be an inadequate proxy for accuracy. The results of this study highlight the importance of the expert verification phase when using citizen science data. The confidence score facilitates a streamlined approach to the verification process by reducing the time taken to validate records, while assessing the three levels of uncertainty within observations and reducing researcher bias. It is recommended that this confidence score be used as an essential tool when using citizen science derived data.

Ecology and EvolutionVol. 14(10)
Stellenbosch University (ZA)
Life below water
Openalex Percentile: Top 2%
Species Distribution and Climate Change
11.95
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.