Tropical Pruning Strategies for ANN optimization in IoT
This study focuses on optimizing Multi-Layer Perceptron (MLP) neural networks for deployment in resource-constrained edge computing environments like smartphones and Internet of Things (IoT) devices. The proposed method involves using auxiliary dense Morphological Neural Networks (MNN) to generate pruning masks for each hidden layer in the MLP. These MNN have shown high efficiency in the pruning process, leading to a significant reduction in the total number of parameters. The effectiveness of our proposal is explained and validated using the Fashion-MNIST dataset. Furthermore, the performance of the optimized MLP is evaluated on an IoT platform, and compared with other state-of-the-art pruning techniques. The experimental results show the effectiveness of the proposed technique in reducing model complexity, improving power efficiency, and decreasing inference response time, while maintaining minimal impact on overall MLP accuracy. These findings have important implications for the development of efficient and scalable deep learning models tailored for edge computing applications.
Authors
- M. Roca (ORCID: https://orcid.org/0000-0003-4648-5683)
- Alejandro Morán (ORCID: https://orcid.org/0000-0001-7628-0019)
- Vincent Canals (ORCID: https://orcid.org/0000-0002-8394-4159)
- J. Font (ORCID: https://orcid.org/0000-0003-3463-0169)
- Josep L. Rosselló (ORCID: https://orcid.org/0000-0001-5390-2276)
- Lluc Crespí-Castañer
- Murti Bär (ORCID: https://orcid.org/0009-0005-4217-8602)
Institutions
- Universitat de les Illes Balears (ES)
Publication Details
- Published
- 2024-11-13
- DOI
- https://doi.org/10.1109/dcis62603.2024.10769153
- Primary Topic
- IoT-based Smart Home Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00