SATRN: Spiking Audio Tagging Robust Network
Audio tagging, as a fundamental task in acoustic signal processing, has demonstrated significant advances and broad applications in recent years. Spiking Neural Networks (SNNs), inspired by biological neural systems, exploit event-driven computing paradigms and temporal information processing, enabling superior energy efficiency. Despite the increasing adoption of SNNs, the potential of event-driven encoding mechanisms for audio tagging remains largely unexplored. This work presents a pioneering investigation into event-driven encoding strategies for SNN-based audio tagging. We propose the SATRN (Spiking Audio Tagging Robust Network), a novel architecture that integrates temporal–spatial attention mechanisms with membrane potential residual connections. The network employs a dual-stream structure combining global feature fusion and local feature extraction through inverted bottleneck blocks, specifically designed for efficient audio processing. Furthermore, we introduce an event-based encoding approach that enhances the resilience of Spiking Neural Networks to disturbances while maintaining performance. Our experimental results on the Urbansound8k and FSD50K datasets demonstrate that the SATRN achieves comparable performance to traditional Convolutional Neural Networks (CNNs) while requiring significantly less computation time and showing superior robustness against noise perturbations, making it particularly suitable for edge computing scenarios and real-time audio processing applications.
Authors
- Shouwei Gao (ORCID: https://orcid.org/0000-0001-9268-0995)
- Philip S. Yu (ORCID: https://orcid.org/0000-0002-3491-5968)
- Xiangyu Fan (ORCID: https://orcid.org/0000-0002-6793-5703)
- Hao Zhou (ORCID: https://orcid.org/0000-0003-0087-5555)
- Zihao Zhu (ORCID: https://orcid.org/0000-0003-2768-8477)
- Xingyang Deng
Institutions
- Shanghai University (CN)
Publication Details
- Journal
- Electronics
- Published
- 2025-02-15
- DOI
- https://doi.org/10.3390/electronics14040761
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Key Research and Development Program of China