Skip to main content

BUILDING A SCALABLE WILDLIFE MONITORING SYSTEM BY INTEGRATING REMOTE CAMERA SAMPLING AND ARTIFICIAL INTELLIGENCE WITH ESSENTIAL BIODIVERSITY VARIABLES

PCI2023-145963-2

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para Afrontar las Prioridades de Nuestro Entorno
Subprogram Subprograma Estatal de Internacionalización
Call Proyectos Programación Conjunta Internacional
Call year 2023
State Plan 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDAD DE HUELVA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 1
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Essential tools but overlooked bias: Artificial intelligence and citizen science classification affect camera trap data

  • Santoro, Simone
  • Gutiérrez-Zapata, Santiago
  • Calzada, Javier
  • Selva, Nuria
  • Marín-Santos, Diego
  • Beery, Sara
  • Brandis, Kate
  • Fernández de Viana, Iñaki
  • Meek, Paul
  • Mortelliti, Alessio
  • Revilla, Eloy
  • Rodríguez, Jon Paul
  • Straková, Lenka
  • Tenan, Simone
  • Gegúndez, Manuel E.
Camera trapping generates vast image datasets requiring classification before downstream ecological inference, yet the influence of classification errors on subsequent analyses is often overlooked. Classification performance can vary widely depending on the classification method (e.g. citizen science vs. artificial intelligence [AI]), species, illumination conditions (diurnal vs. nocturnal) and other contextual factors. We compared a citizen science classification method to two AI classifiers (EfficientNet and DeepFaune) using an expert-labelled hold-out of 51,588 images across seven classes (‘empty’, ‘human’, ‘cervid’, ‘wild boar’, ‘red fox’, ‘leporid’ and ‘European badger’) captured day and night. For each class and method, we quantified precision (accuracy of positive predictions) and recall (ability to detect all positive instances), then fitted single-season occupancy models to the classified data and compared estimates against expert-derived benchmarks. Finally, we conducted a large-scale simulation to investigate how true occupancy, detection probability and classification performance (recall and precision) collectively influence the accuracy (root mean square error [RMSE]) of occupancy estimates. Citizen scientists exhibited consistently high precision but more variable recall. The AI classifiers outperformed the citizen science method in recall for several species, including wild boar, leporid and European badger. Both approaches performed worse on nocturnal images and showed reduced precision for night-time ‘empty’ images. Bias in occupancy estimates differed across species, methods and space—the AI-based estimates were generally more biased, with both the magnitude and direction of bias varying spatially, especially for rarer species such as leporids. In our simulation study, precision emerged as the strongest predictor of occupancy model accuracy, with lower precision substantially increasing RMSE. Lower occupancy rates increased RMSE, and precision regulated the impact of detection probability: at low precision, higher detection probability worsened errors; at high precision, RMSE remained low—or even decreased—as detection probability rose. Although AI classifiers offer unmatched processing speed, our findings show that citizen science can reduce classification errors. Moreover, low precision and poor recall, especially for rare or nocturnal species, can substantially bias occupancy models. Based on our results, we recommend improving precision and accounting for classification quality and uncertainty to ensure robust inference from camera trap data., This research was funded by Biodiversa+, the European Biodiversity Partnership, in the context of the WildINTEL project under the 2022–2023 BiodivMon joint call. It was co-funded by the European Commission (GA No. 101052342) and the following funding organisations: Agencia Estatal de Investigación (Spain, PCI2023-145963-2), National Science Centre (Poland, 2023/05/Y/NZ8/00104), the Research Council of Norway (Norway) and the German Research Foundation (Germany). Additional support was provided by Fundación Biodiversidad, Ministerio para la Transición Ecológica y el Reto Demográfico, Project AI-CENSUS and the Programa Operativo FEDER Andalucía 2014–2020, Project UHU-202028. SGZ acknowledges support from Santander SHEs grants at the University of Huelva. NS acknowledges support from a María Zambrano scholarship from the University of Huelva. This publication uses data generated via the Zooniverse.org platform, development of which is funded by generous support, including a Global Impact Award from Google, and by a grant from the Alfred P. Sloan Foundation., Peer reviewed