Decentralized ADMM with compressed and event-triggered communication

• Published in: Neural networks Vol. 165; pp. 472 - 482
• Main Authors: Zhang, Zhen, Yang, Shaofu, Xu, Wenying
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.08.2023
• Subjects: ADMM; Decentralized optimization; Efficient communication; Second-order algorithms; Efficient communication; Decentralized optimization; ADMM; Second-order algorithms
• ISSN: 0893-6080; 1879-2782
• DOI: 10.1016/j.neunet.2023.06.001

This paper considers the decentralized optimization problem, where agents in a network cooperate to minimize the sum of their local objective functions by communication and local computation. We propose a decentralized second-order communication-efficient algorithm called communication-censored and communication-compressed quadratically approximated alternating direction method of multipliers (ADMM), termed as CC-DQM, by combining event-triggered communication with compressed communication. In CC-DQM, agents are allowed to transmit the compressed message only when the current primal variables have changed greatly compared to its last estimate. Moreover, to relieve the computation cost, the update of Hessian is also scheduled by the trigger condition. Theoretical analysis shows that the proposed algorithm can still maintain an exact linear convergence, despite the existence of compression error and intermittent communication, if the local objective functions are strongly convex and smooth. Finally, numerical experiments demonstrate its satisfactory communication efficiency.