Min-Max Cost Optimization for Efficient Hierarchical Federated Learning in Wireless Edge Networks

• Published in: IEEE transactions on parallel and distributed systems Vol. 33; no. 11; pp. 2687 - 2700
• Main Authors: Feng, Jie, Liu, Lei, Pei, Qingqi, Li, Keqin
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.11.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Collaborative work; Computational modeling; Convergence; CPU-cycle frequency; Data models; Decomposition; Federated learning; Heuristic methods; Iterative algorithms; local accuracy; Machine learning; min-max cost; Mixed integer; Nonlinear programming; Optimization; Resource management; Servers; Smart devices; Subcarriers; Training; wireless edge networks; Wireless networks
• ISSN: 1045-9219; 1558-2183
• DOI: 10.1109/TPDS.2021.3131654

Federated learning is a distributed machine learning technology that can protect users' data privacy, so it has attracted more and more attention in the industry and academia. Nonetheless, most of the existing works focused on the cost optimization of the entire process, while the cost of individual participants cannot be considered. In this article, we explore a min-max cost-optimal problem to guarantee the convergence rate of federated learning in terms of cost in wireless edge networks. In particular, we minimize the cost of the worst-case participant subject to the delay, local CPU-cycle frequency, power allocation, local accuracy, and subcarrier assignment constraints. Considering that the formulated problem is a mixed-integer nonlinear programming problem, we decompose it into several sub-problems to derive its solutions, in which the subcarrier assignment and power allocation are obtained by utilizing the Lagrangian dual decomposition method, the CPU-cycle frequency is obtained by a heuristic algorithm, and the local accuracy is obtained by an iteration algorithm. Simulation results show the convergence of the proposed algorithm and reveal that the proposed scheme can accomplish a tradeoff between the cost and fairness by comparing the proposed scheme with the existing schemes.