A Multi-Time-Frequency Feature Fusion Approach for Marine Mammal Sound Recognition

Accurate acoustic identification of marine mammals is vital for monitoring ocean health and human impacts. Existing methods often struggle with limited single-feature representations or suboptimal fusion of multiple features. This paper proposes an Evaluation-Adaptive Weighted Multi-Head Fusion Network that integrates CQT and STFT features via a dual-branch ResNet architecture. The model enhances intra-branch features using channel attention and adaptive weighting of each branch based on its validation accuracy during training. Experiments on the Watkins Marine Mammal Sound Database show that the proposed method achieves superior performance, reaching 96.05% accuracy and outperforming baseline and attention-based fusion models. This approach offers an effective solution for multi-feature acoustic recognition in complex underwater environments.

Authors

Institutions

Publication Details

Journal
Journal of Marine Science and Engineering
Published
2025-05-30
DOI
https://doi.org/10.3390/jmse13061101
Citations
1
Primary Topic
Marine animal studies overview
Type
article
Field-Weighted Citation Impact
1.72

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multi-Time-Frequency Feature Fusion Approach for Marine Mammal Sound Recognition

Suya Liu, Yinan Xu, Yihu Xu, Yujing Wu et al.
1 citations
Journal of Marine Science and Engineering
Marine animal studies overview
1.72
article

A Multi-Time-Frequency Feature Fusion Approach for Marine Mammal Sound Recognition

Suya Liu, Yinan Xu, Yihu Xu, Yujing Wu, Xiangxu Meng, Kye-Won Kim, Xin Liu, Hang Li
article en
1 citations

Abstract

Accurate acoustic identification of marine mammals is vital for monitoring ocean health and human impacts. Existing methods often struggle with limited single-feature representations or suboptimal fusion of multiple features. This paper proposes an Evaluation-Adaptive Weighted Multi-Head Fusion Network that integrates CQT and STFT features via a dual-branch ResNet architecture. The model enhances intra-branch features using channel attention and adaptive weighting of each branch based on its validation accuracy during training. Experiments on the Watkins Marine Mammal Sound Database show that the proposed method achieves superior performance, reaching 96.05% accuracy and outperforming baseline and attention-based fusion models. This approach offers an effective solution for multi-feature acoustic recognition in complex underwater environments.

Journal of Marine Science and EngineeringVol. 13(6)
Hoseo University (KR), Yanbian University (CN)
Natural Science Foundation of Jilin Province, National Natural Science Foundation of China, People's Government of Jilin Province
Life below water
Openalex Percentile: Top 17%
Marine animal studies overview
1.72
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.