Whombat: An open‐source audio annotation tool for machine learning assisted bioacoustics

Abstract Automated analysis of bioacoustic recordings using machine learning (ML) methods has the potential to greatly scale biodiversity monitoring efforts. The use of ML for high‐stakes applications, such as conservation and scientific research, demands a data‐centric approach with a focus on selecting and utilizing carefully annotated and curated evaluation and training data that are relevant and representative. Creating annotated bioacoustic datasets presents a number of challenges, such as managing large collections of recordings with associated metadata, developing flexible annotation tools that can accommodate the diverse range of vocalization profiles of different organisms and addressing the scarcity of expert annotators. We present Whombat, a user‐friendly, browser‐based interface for managing audio recordings and annotation projects, with several visualization, exploration and annotation tools. It enables users to quickly annotate, review, and share annotations, as well as visualize and evaluate a set of machine learning predictions on a dataset. The tool facilitates an iterative workflow where user annotations and machine learning predictions feedback to enhance model performance and annotation quality. We demonstrate the flexibility of Whombat by showcasing two distinct use cases: (1) a project aimed at enhancing automated UK bat call identification at the Bat Conservation Trust (BCT), and (2) a collaborative effort among the USDA Forest Service and Oregon State University researchers exploring bioacoustic applications and extending automated avian classification models in the Pacific Northwest, USA. Whombat is a flexible tool that can effectively address the challenges of annotation for bioacoustic research. It can be used for individual and collaborative work, hosted on a shared server or accessed remotely, or run on a personal computer without the need for coding skills. The code is open‐source, and we provide a user guide.

Authors

Institutions

Publication Details

Journal
Methods in Ecology and Evolution
Published
2024-12-03
DOI
https://doi.org/10.1111/2041-210x.14468
Citations
5
Primary Topic
Animal Vocal Communication and Behavior
Type
article
Field-Weighted Citation Impact
2.55

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Whombat: An open‐source audio annotation tool for machine learning assisted bioacoustics

Ella Browning, Holly Pringle, Kate E. Jones, Santiago Martínez Balvanera et al.
5 citations
Methods in Ecology and Evolution
Animal Vocal Communication and Behavior
2.55
article

Whombat: An open‐source audio annotation tool for machine learning assisted bioacoustics

Ella Browning, Holly Pringle, Kate E. Jones, Santiago Martínez Balvanera, Oisin Mac Aodha, Matthew J. Weldy
article en
5 citations

Abstract

Abstract Automated analysis of bioacoustic recordings using machine learning (ML) methods has the potential to greatly scale biodiversity monitoring efforts. The use of ML for high‐stakes applications, such as conservation and scientific research, demands a data‐centric approach with a focus on selecting and utilizing carefully annotated and curated evaluation and training data that are relevant and representative. Creating annotated bioacoustic datasets presents a number of challenges, such as managing large collections of recordings with associated metadata, developing flexible annotation tools that can accommodate the diverse range of vocalization profiles of different organisms and addressing the scarcity of expert annotators. We present Whombat, a user‐friendly, browser‐based interface for managing audio recordings and annotation projects, with several visualization, exploration and annotation tools. It enables users to quickly annotate, review, and share annotations, as well as visualize and evaluate a set of machine learning predictions on a dataset. The tool facilitates an iterative workflow where user annotations and machine learning predictions feedback to enhance model performance and annotation quality. We demonstrate the flexibility of Whombat by showcasing two distinct use cases: (1) a project aimed at enhancing automated UK bat call identification at the Bat Conservation Trust (BCT), and (2) a collaborative effort among the USDA Forest Service and Oregon State University researchers exploring bioacoustic applications and extending automated avian classification models in the Pacific Northwest, USA. Whombat is a flexible tool that can effectively address the challenges of annotation for bioacoustic research. It can be used for individual and collaborative work, hosted on a shared server or accessed remotely, or run on a personal computer without the need for coding skills. The code is open‐source, and we provide a user guide.

Methods in Ecology and EvolutionVol. 16(1)
Oregon State University (US), Bat Conservation Trust (GB), Pacific Northwest Research Station (US), University College London (GB), University of Edinburgh (GB)
Sight Research UK, Consejo Nacional de Ciencia y Tecnología, Natural Environment Research Council
Life in Land
Openalex Percentile: Top 11%
Animal Vocal Communication and Behavior
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.