<scp>orcAI</scp> : A Machine Learning Tool to Detect and Classify Acoustic Signals of Killer Whales in Audio Recordings

ABSTRACT Acoustic monitoring is an essential tool for investigating animal communication and behavior when visual contact is limited, but the scalability of bioacoustic projects is often limited by time‐intensive manual auditing of focal signals. To address this bottleneck, we introduce orcAI—a novel deep learning framework for the automated detection and classification of a broad acoustic repertoire of killer whales ( Orcinus orca ), including vocalizations (e.g., pulsed calls, whistles) and incidental sounds (e.g., breathing, tail slaps). orcAI combines a ResNet‐based Convolutional Neural Network (ResNet‐CNN) with Long Short‐Term Memory (LSTM) layers to capture both spatial features and temporal context, enabling the model to classify signals and to accurately determine their temporal boundaries in spectrograms. Trained on a comprehensive dataset from herring‐feeding killer whales off Iceland, the framework was designed to be adaptable to other populations upon training with equivalent data. Our final model achieves up to 98.2% accuracy on test data and is delivered as an open‐source tool with an easy‐to‐use command‐line interface. By providing a ready‐to‐use model that processes raw audio and outputs annotations, orcAI serves as a useful tool for advancing the study of killer whale vocal behavior and, more broadly, for understanding marine mammal communication and ecology.

Authors

Institutions

Publication Details

Journal
Marine Mammal Science
Published
2025-10-07
DOI
https://doi.org/10.1111/mms.70083
Primary Topic
Marine animal studies overview
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

orcAI : A Machine Learning Tool to Detect and Classify Acoustic Signals of Killer Whales in Audio Recordings

Patrick J. O. Miller, Filipa I. P. Samarra, Sebastian Bonhoeffer, Daniel C. Angst et al.
Marine Mammal Science
Marine animal studies overview
article

orcAI : A Machine Learning Tool to Detect and Classify Acoustic Signals of Killer Whales in Audio Recordings

Patrick J. O. Miller, Filipa I. P. Samarra, Sebastian Bonhoeffer, Daniel C. Angst, Chérine D. Baumgartner, Anna Selbmann, Nicolas Ochsner
article en

Abstract

ABSTRACT Acoustic monitoring is an essential tool for investigating animal communication and behavior when visual contact is limited, but the scalability of bioacoustic projects is often limited by time‐intensive manual auditing of focal signals. To address this bottleneck, we introduce orcAI—a novel deep learning framework for the automated detection and classification of a broad acoustic repertoire of killer whales ( Orcinus orca ), including vocalizations (e.g., pulsed calls, whistles) and incidental sounds (e.g., breathing, tail slaps). orcAI combines a ResNet‐based Convolutional Neural Network (ResNet‐CNN) with Long Short‐Term Memory (LSTM) layers to capture both spatial features and temporal context, enabling the model to classify signals and to accurately determine their temporal boundaries in spectrograms. Trained on a comprehensive dataset from herring‐feeding killer whales off Iceland, the framework was designed to be adaptable to other populations upon training with equivalent data. Our final model achieves up to 98.2% accuracy on test data and is delivered as an open‐source tool with an easy‐to‐use command‐line interface. By providing a ready‐to‐use model that processes raw audio and outputs annotations, orcAI serves as a useful tool for advancing the study of killer whale vocal behavior and, more broadly, for understanding marine mammal communication and ecology.

Marine Mammal ScienceVol. 42(1)
University of Iceland (IS), University of St Andrews (GB), University of Zurich (CH), ETH Zurich (CH), Federal Roads Office (CH), Collegium Helveticum (CH)
Earthwatch Institute, National Geographic Society, University of St Andrews, Eidgenössische Technische Hochschule Zürich, Fundação para a Ciência e a Tecnologia, Office of Naval Research
Openalex Percentile: Top 73%
Marine animal studies overview
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.