Whombat: An open-source audio annotation tool for machine learning assisted bioacoustics

Automated analysis of bioacoustic recordings using machine learning (ML) methods has the potential to greatly scale biodiversity monitoring efforts. The use of ML for high-stakes applications, such as conservation and scientific research, demands a data-centric approach with a focus on selecting and utilizing carefully annotated and curated evaluation and training data that are relevant and representative. Creating annotated bioacoustic datasets presents a number of challenges, such as managing large collections of recordings with associated metadata, developing flexible annotation tools that can accommodate the diverse range of vocalization profiles of different organisms and addressing the scarcity of expert annotators. We present Whombat, a user-friendly, browser-based interface for managing audio recordings and annotation projects, with several visualization, exploration and annotation tools. It enables users to quickly annotate, review, and share annotations, as well as visualize and evaluate a set of machine learning predictions on a dataset. The tool facilitates an iterative workflow where user annotations and machine learning predictions feedback to enhance model performance and annotation quality. We demonstrate the flexibility of Whombat by showcasing two distinct use cases: (1) a project aimed at enhancing automated UK bat call identification at the Bat Conservation Trust (BCT), and (2) a collaborative effort among the USDA Forest Service and Oregon State University researchers exploring bioacoustic applications and extending automated avian classification models in the Pacific Northwest, USA. Whombat is a flexible tool that can effectively address the challenges of annotation for bioacoustic research. It can be used for individual and collaborative work, hosted on a shared server or accessed remotely, or run on a personal computer without the need for coding skills. The code is open-source, and we provide a user guide.

Publication Details

Journal
UCL Discovery (University College London)
Published
2024-12-03
Primary Topic
Animal Vocal Communication and Behavior
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Whombat: An open-source audio annotation tool for machine learning assisted bioacoustics

UCL Discovery (University College London)
Animal Vocal Communication and Behavior
article

Whombat: An open-source audio annotation tool for machine learning assisted bioacoustics

article en

Abstract

Automated analysis of bioacoustic recordings using machine learning (ML) methods has the potential to greatly scale biodiversity monitoring efforts. The use of ML for high-stakes applications, such as conservation and scientific research, demands a data-centric approach with a focus on selecting and utilizing carefully annotated and curated evaluation and training data that are relevant and representative. Creating annotated bioacoustic datasets presents a number of challenges, such as managing large collections of recordings with associated metadata, developing flexible annotation tools that can accommodate the diverse range of vocalization profiles of different organisms and addressing the scarcity of expert annotators. We present Whombat, a user-friendly, browser-based interface for managing audio recordings and annotation projects, with several visualization, exploration and annotation tools. It enables users to quickly annotate, review, and share annotations, as well as visualize and evaluate a set of machine learning predictions on a dataset. The tool facilitates an iterative workflow where user annotations and machine learning predictions feedback to enhance model performance and annotation quality. We demonstrate the flexibility of Whombat by showcasing two distinct use cases: (1) a project aimed at enhancing automated UK bat call identification at the Bat Conservation Trust (BCT), and (2) a collaborative effort among the USDA Forest Service and Oregon State University researchers exploring bioacoustic applications and extending automated avian classification models in the Pacific Northwest, USA. Whombat is a flexible tool that can effectively address the challenges of annotation for bioacoustic research. It can be used for individual and collaborative work, hosted on a shared server or accessed remotely, or run on a personal computer without the need for coding skills. The code is open-source, and we provide a user guide.

UCL Discovery (University College London)
Life in Land
Openalex Percentile: Top 48%
Animal Vocal Communication and Behavior
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Whombat: An open-source audio annotation tool for machine learning assisted bioacoustics · UCL Discovery (University College London) (2024) | TGRS Research Map | TGRS