A distributed newton method for processing signals defined on the large-scale networks

• Published in: China communications Vol. 20; no. 5; pp. 315 - 329
• Main Authors: Zhang, Yanhai, Jiang, Junzheng, Wang, Haitao, Ma, Mou
• Format: Journal Article
• Language: English
• Published: China Institute of Communications 01.05.2023; School of Information and Communication,Guilin University of Electronic Technology,Guilin 541004,China; College of Science,Guilin University of Technology,Guilin 541004,China%School of Information and Communication,Guilin University of Electronic Technology,Guilin 541004,China
• Subjects: active network decomposition; Costs; distributed Newton method; graph signal processing; Matrix decomposition; Newton method; second-order algorithm; Signal processing; Signal processing algorithms; Task analysis; Wireless sensor networks; active network decomposition; distributed New-ton method; second-order algorithm; graph signal processing
• ISSN: 1673-5447
• DOI: 10.23919/JCC.2023.00.002

In the graph signal processing (GSP) framework, distributed algorithms are highly desirable in processing signals defined on large-scale networks. However, in most existing distributed algorithms, all nodes homogeneously perform the local computation, which calls for heavy computational and communication costs. Moreover, in many real-world networks, such as those with straggling nodes, the homogeneous manner may result in serious delay or even failure. To this end, we propose active network decomposition algorithms to select non-straggling nodes (normal nodes) that perform the main computation and communication across the network. To accommodate the decomposition in different kinds of networks, two different approaches are developed, one is centralized decomposition that leverages the adjacency of the network and the other is distributed decomposition that employs the indicator message transmission between neighboring nodes, which constitutes the main contribution of this paper. By incorporating the active decomposition scheme, a distributed Newton method is employed to solve the least squares problem in GSP, where the Hessian inverse is approximately evaluated by patching a series of inverses of local Hessian matrices each of which is governed by one normal node. The proposed algorithm inherits the fast convergence of the second-order algorithms while maintains low computational and communication cost. Numerical examples demonstrate the effectiveness of the proposed algorithm.