When Federated Learning Meets Knowledge Distillation to Secure Consumer Edge Network

Consumer networks face several security challenges due to the distributed nature of edge devices and the sensitive data they handle. Federated Learning (FL) presents a promising paradigm for collaborative model training in distributed environments. However, its implementation in edge consumer networks raises concerns about model heterogeneity, communication efficiency, and reverse engineering attacks. To address these issues, in this paper, we introduce SKDFL, a novel framework that leverages Knowledge Distillation (KD) and Secure Multi-Party Computation (SMPC) techniques to enhance communication efficiency while preserving data privacy in edge consumer networks. Through the use of KD, the distilled knowledge is transmitted between devices, significantly reducing communication overhead. Additionally, we incorporate lightweight encryption mechanisms to protect soft-labels from reverse engineering attacks using SMPC. We evaluate our proposed framework using two public datasets and demonstrate its efficiency in reducing communication costs, achieving up to a 92.4% reduction compared to conventional FL methods. Moreover, SKDFL achieves high performances in terms of accuracy and F1-score in both binary and multi-class classification while preserving the privacy of clients. Our obtained results show the potential of SKDFL to address the challenges of communication efficiency and data privacy in FL for edge consumer networks, paving the way for secure and efficient collaborative learning in consumer networks.