A Novel Hierarchically Decentralized Federated Learning Framework in 6G Wireless Networks

Abstract

Decentralized federated learning (DFL) architecture enables clients to collaboratively train a shared machine learning model without a central parameter server. However, it is difficult to apply in multicell scenarios. In this paper, we propose an integrated hierarchically decentralized federated learning (HDFL) framework, where devices from different cells collaboratively train a global model under periodically intra-cell D2D consensus and inter-cell aggregation. We establish strong convergence guarantees for the proposed HDFL algorithm without assuming convex objectives. The convergence rate of HDFL can be optimized to achieve the balance of model accuracy and communication overhead. To improve the wireless performance of HDFL, we formulate an optimization problem to minimize the training latency and energy overhead. Numerical results based on the CIFAR-10 dataset validate the superiority of HDFL over traditional DFL methods in the multicell scenario.