A Multi-Time-Frequency Feature Fusion Approach for Marine Mammal Sound Recognition
Accurate acoustic identification of marine mammals is vital for monitoring ocean health and human impacts. Existing methods often struggle with limited single-feature representations or suboptimal fusion of multiple features. This paper proposes an Evaluation-Adaptive Weighted Multi-Head Fusion Network that integrates CQT and STFT features via a dual-branch ResNet architecture. The model enhances intra-branch features using channel attention and adaptive weighting of each branch based on its validation accuracy during training. Experiments on the Watkins Marine Mammal Sound Database show that the proposed method achieves superior performance, reaching 96.05% accuracy and outperforming baseline and attention-based fusion models. This approach offers an effective solution for multi-feature acoustic recognition in complex underwater environments.
Authors
- Suya Liu
- Yinan Xu (ORCID: https://orcid.org/0000-0002-4130-644X)
- Yihu Xu (ORCID: https://orcid.org/0000-0002-7387-1865)
- Yujing Wu (ORCID: https://orcid.org/0000-0002-9339-0866)
- Xiangxu Meng (ORCID: https://orcid.org/0000-0001-9842-4044)
- Kye-Won Kim
- Xin Liu (ORCID: https://orcid.org/0009-0002-8720-7858)
- Hang Li (ORCID: https://orcid.org/0000-0001-5096-0155)
Institutions
- Hoseo University (KR)
- Yanbian University (CN)
Publication Details
- Journal
- Journal of Marine Science and Engineering
- Published
- 2025-05-30
- DOI
- https://doi.org/10.3390/jmse13061101
- Citations
- 1
- Primary Topic
- Marine animal studies overview
- Type
- article
- Field-Weighted Citation Impact
- 1.72
Funders
- Natural Science Foundation of Jilin Province
- National Natural Science Foundation of China
- People's Government of Jilin Province