Cluster-Based Device Scheduling Design for Semi-Asynchronous Federated Learning in Mobile Edge Computing Networks

In mobile edge computing (MEC) networks, federated learning (FL) has emerged as the leading distributed framework for training a shared machine learning model, primarily benefiting from its ability to exchange the information of edge devices (EDs) while safeguarding their privacy. However, in MEC networks, the heterogeneity of communication, computation, and data can result in challenges such as stragglers and data imbalances, thereby impeding the training process of FL. To address these challenges, we propose a Semi-Asynchronous Federated Learning (Semi-AFL) framework with cluster-based scheduling. In Semi-AFL, the EDs can perform local training at their own pace using different stale global models to tackle the straggler effect. Considering the asynchronousity of Semi-AFL and data heterogeneity, we propose a cluster-based scheduling strategy that includes device clustering and device selection. Specifically, it performs clustering based on the label distribution and obtains device-to-cluster information. We further select devices based on clustering information as well as model staleness and contribution, aiming to reduce variance and bias and accelerate model convergence. Experiment results demonstrate the effectiveness of the proposed method in reducing the latency of FL.