Privacy-Preserving Distributed Online Stochastic Optimization With Time-Varying Distributions

• Published in: IEEE transactions on control of network systems Vol. 10; no. 2; pp. 1069 - 1082
• Main Authors: Wang, Haojun, Liu, Kun, Han, Dongyu, Chai, Senchun, Xia, Yuanqing
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.06.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Constraints; Cost function; Costs; Cryptography; Decomposition; Distributed online optimization; Heuristic algorithms; Indexes; Network systems; Optimization; Privacy; privacy preservation; regret analysis; stochastic optimization; time-varying distributions
• ISSN: 2325-5870; 2372-2533
• DOI: 10.1109/TCNS.2022.3219765

This article investigates the privacy-preserving distributed online stochastic optimization problem with random parameters following time-varying distributions, where a set of nodes cooperatively minimize a sum of expectation-valued local cost functions subject to coupled constraints. First, a function-decomposition-based privacy-preserving method is provided to preserve the private subgradient information of each node, which can guarantee both privacy preservation and convergence accuracy. Then, a privacy-preserving distributed online stochastic optimization algorithm is proposed based on the primal-dual method. It is proved that the dynamic regret and the constraint violation are sublinear. The relationship of the dynamic regret between before and after function decomposition is provided, and so is the constraint violation. Finally, a numerical simulation is provided to demonstrate the effectiveness of the proposed algorithm.