AVSE-Pruner: Filter Pruning of Audio-Visual Speech Enhancement System using Multi-objective Binary Particle Swarm Optimization

This paper optimizes filter pruning as a constrained multiobjective optimization problem using a new binary multiobjective particle swarm optimization with dynamic learning strategies (AVSE-Pruner).AVSE-Pruner aims to balance network performance and computational cost by incorporating dynamic learning strategies to adjust search behavior.Applying AVSE-Pruner, we pruned the baseline model for the Audio-Visual Speech Enhancement (AVSE) Challenge, which enhances speech intelligibility in noisy environments using audio and visual inputs.Our pruned model maintains high performance while significantly reducing computational burden, demonstrating its suitability for real-time embedded applications.

Authors

Publication Details

Published
2024-09-01
DOI
https://doi.org/10.21437/avsec.2024-6
Citations
1
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AVSE-Pruner: Filter Pruning of Audio-Visual Speech Enhancement System using Multi-objective Binary Particle Swarm Optimization

João Paulo Papa, Jihene Tmamna, Tughrul Arslan, Najwa Kouka et al.
1 citations
Speech and Audio Processing
0.35
article

AVSE-Pruner: Filter Pruning of Audio-Visual Speech Enhancement System using Multi-objective Binary Particle Swarm Optimization

João Paulo Papa, Jihene Tmamna, Tughrul Arslan, Najwa Kouka, Leandro A. Passos, Kia Dashtipour, Amir Hussain, Mandar Gogate, Rahma Fourati
article en
1 citations

Abstract

This paper optimizes filter pruning as a constrained multiobjective optimization problem using a new binary multiobjective particle swarm optimization with dynamic learning strategies (AVSE-Pruner).AVSE-Pruner aims to balance network performance and computational cost by incorporating dynamic learning strategies to adjust search behavior.Applying AVSE-Pruner, we pruned the baseline model for the Audio-Visual Speech Enhancement (AVSE) Challenge, which enhances speech intelligibility in noisy environments using audio and visual inputs.Our pruned model maintains high performance while significantly reducing computational burden, demonstrating its suitability for real-time embedded applications.

Fundação de Amparo à Pesquisa do Estado de São Paulo, Engineering and Physical Sciences Research Council
Openalex Percentile: Top 45%
Speech and Audio Processing
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

AVSE-Pruner: Filter Pruning of Audio-Visual Speech Enhancement System using Multi-objective Binary Particle Swarm Optimization — João Paulo Papa, Jihene Tmamna, et al. · (2024) | TGRS Research Map | TGRS