Being confident in confidence scores: calibration in deep learning models for camera trap image sequences

Gaspard Dussert, Simon Chamaillé‐Jammes, Stéphane Dray, Vincent Miele

Remote Sensing in Ecology and Conservation 2024 article cited by 29

importance 4/10 ai assisted Advanced Neural Network Applications wildlife ecology stage: research

Automated deep learning classifiers for camera trap images produce confidence scores that may not be interpretable as true probabilities, limiting their use in ecological tasks like occupancy estimation.

Ecologists process camera trap images at massive scale, and unreliable confidence scores could distort wildlife population estimates.

The study investigates whether deep learning species classifiers on a large European camera trap dataset are well calibrated, including predictions aggregated across image sequences, and tests a post-hoc temperature scaling method.

not stated in source

The work could make automated species identification more trustworthy for downstream ecological tasks.

Venue Remote Sensing in Ecology and Conservation
Published 2024
Work type article
Authors Gaspard Dussert, Simon Chamaillé‐Jammes, Stéphane Dray, Vincent Miele
Citations 29 (OpenAlex, at import time)
References 45
Model or method deep learning species classification models; temperature scaling (abstract truncated)
Organization not stated in source
Primary source https://doi.org/10.1002/rse2.412
Open access gold
Keywords camera traps, deep learning, calibration, species classification, confidence scores
4 / 10

real but narrower advance

Calibration affects reliability of camera trap species classification for ecological tasks like occupancy estimation; niche methodological advance, no scale quantified.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 AlphaFold Protein Structure Database: massively expanding the structural coverage of protein-sequence space with high-accuracy models
Mihály Váradi, Stephen Anyango, Mandar Deshpande, Sreenath Sasidharan...
2021 7,782
9
2 Evolutionary-scale prediction of atomic-level protein structure with a language model
Zeming Lin, Halil Akin, Roshan Rao, Brian Hie, Zhongkai Zhu, Wenting L...
2023 5,455
9
3 Accurate prediction of protein structures and interactions using a three-track neural network
Minkyung Baek, Frank DiMaio, Ivan V. Anishchenko, Justas Dauparas, Ser...
2021 5,468
9
4 De novo design of protein structure and function with RFdiffusion
Joseph L. Watson, David Juergens, Nathaniel R. Bennett, Brian L. Tripp...
2023 2,294
9
5 Structure Prediction and Computational Protein Design for Efficient Biocatalysts and Bioactive Proteins
Rebecca Buller, Jiřı́ Damborský, Donald Hilvert, Uwe T. Bornscheuer
2024 40
9