Dual-Feature Fusion Learning: An Acoustic Signal Recognition Method for Marine Mammals
Marine mammal acoustic signal recognition is a key technology for species conservation and ecological environment monitoring. Aiming at the complex and changing marine environment, and because the traditional recognition method based on a single feature input has the problems of poor environmental adaptability and low recognition accuracy, this paper proposes a dual-feature fusion learning method. First, dual-domain feature extraction is performed on marine mammal acoustic signals to overcome the limitations of single feature input methods by interacting feature information between the time-frequency domain and the Delay-Doppler domain. Second, this paper constructs a dual-feature fusion learning target recognition model, which improves the generalization ability and robustness of mammal acoustic signal recognition in complex marine environments. Finally, the feasibility and effectiveness of the dual-feature fusion learning target recognition model are verified in this study by using the acoustic datasets of three marine mammals, namely, the Fraser’s Dolphin, the Spinner Dolphin, and the Long-Finned Pilot Whale. The dual-feature fusion learning target recognition model improved the accuracy of the training set by 3% to 6% and 20% to 23%, and the accuracy of the test set by 1% to 3% and 25% to 38%, respectively, compared to the model that used the time-frequency domain features and the Delay-Doppler domain features alone for recognition.
Authors
- Yaqian Shi (ORCID: https://orcid.org/0000-0003-4958-2286)
- Zhengkai Wang (ORCID: https://orcid.org/0009-0001-8346-5211)
- Dongyue Han
- Fei Yu (ORCID: https://orcid.org/0000-0002-5419-7262)
- Zhong-Rong Lu (ORCID: https://orcid.org/0009-0008-3063-4297)
- Lian‐Gang Lü
Institutions
- Ministry of Natural Resources (CN)
- First Institute of Oceanography (CN)
- Shandong University of Science and Technology (CN)
Publication Details
- Journal
- Remote Sensing
- Published
- 2024-10-14
- DOI
- https://doi.org/10.3390/rs16203823
- Citations
- 6
- Primary Topic
- Marine animal studies overview
- Type
- article
- Field-Weighted Citation Impact
- 2.75
Funders
- Natural Science Foundation of Qingdao
- National Key Research and Development Program of China