NestFL: Enhancing Federated Learning Through Nested Multicapacity Model Pruning in Heterogeneous Edge Computing

Federated learning (FL) has emerged as a pivotal approach for edge-based distributed machine learning, yet it faces significant challenges due to the constrained capacities and heterogeneity of edge devices, including non-IID data distribution, communication constraints, and learning inefficiencies. Furthermore, a one-fits-all global model often fails to perform optimally across diverse participating devices. In this paper, we present NestFL, an efficient FL framework for edge computing that can jointly improve the training efficiency and achieve personalization. Specifically, NestFL innovates by incorporating distributed model pruning, creating a hierarchy of structured-sparse subnetworks tailored to the unique resource profiles of client devices. These subnetworks are integrated into a nested global model, ensuring parameter sharing without increasing the parameter space, thereby significantly reducing computational and communication burdens. Meanwhile, it implements a cross-training mechanism, allowing clients to train on a broader dataset and maintain consistent decision boundaries. Furthermore, a weighted aggregation mechanism is designed to improve training performance and maximally preserve personalization. Experimental results in different applications demonstrate the superiority of NestFL over the baseline approaches in terms of model accuracy, convergence speed, and personalization preservation.