AVSE-Pruner: Filter Pruning of Audio-Visual Speech Enhancement System using Multi-objective Binary Particle Swarm Optimization
This paper optimizes filter pruning as a constrained multiobjective optimization problem using a new binary multiobjective particle swarm optimization with dynamic learning strategies (AVSE-Pruner).AVSE-Pruner aims to balance network performance and computational cost by incorporating dynamic learning strategies to adjust search behavior.Applying AVSE-Pruner, we pruned the baseline model for the Audio-Visual Speech Enhancement (AVSE) Challenge, which enhances speech intelligibility in noisy environments using audio and visual inputs.Our pruned model maintains high performance while significantly reducing computational burden, demonstrating its suitability for real-time embedded applications.
Authors
- João Paulo Papa (ORCID: https://orcid.org/0000-0002-6494-7514)
- Jihene Tmamna (ORCID: https://orcid.org/0000-0002-0537-1746)
- Tughrul Arslan (ORCID: https://orcid.org/0000-0001-8176-5803)
- Najwa Kouka (ORCID: https://orcid.org/0000-0002-6764-1588)
- Leandro A. Passos (ORCID: https://orcid.org/0000-0003-3529-3109)
- Kia Dashtipour (ORCID: https://orcid.org/0000-0002-9651-6487)
- Amir Hussain (ORCID: https://orcid.org/0000-0002-8080-082X)
- Mandar Gogate (ORCID: https://orcid.org/0000-0003-1712-9014)
- Rahma Fourati (ORCID: https://orcid.org/0000-0001-8783-6895)
Publication Details
- Published
- 2024-09-01
- DOI
- https://doi.org/10.21437/avsec.2024-6
- Citations
- 1
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- Fundação de Amparo à Pesquisa do Estado de São Paulo
- Engineering and Physical Sciences Research Council